-- Logs begin at Wed 2022-08-31 23:50:58 UTC, end at Thu 2022-09-01 00:47:05 UTC. -- Sep 01 00:15:47.857160 dv-cinder-820027-21-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 00:15:47.870406 dv-cinder-820027-21-smb devstack@keystone.service[93151]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 00:15:47.873181 dv-cinder-820027-21-smb devstack@keystone.service[93151]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 00:15:47 2022] *** Sep 01 00:15:47.873367 dv-cinder-820027-21-smb devstack@keystone.service[93151]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 00:15:47.873526 dv-cinder-820027-21-smb devstack@keystone.service[93151]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 00:15:47.873695 dv-cinder-820027-21-smb devstack@keystone.service[93151]: nodename: dv-cinder-820027-21-smb Sep 01 00:15:47.873851 dv-cinder-820027-21-smb devstack@keystone.service[93151]: machine: x86_64 Sep 01 00:15:47.874006 dv-cinder-820027-21-smb devstack@keystone.service[93151]: clock source: unix Sep 01 00:15:47.874157 dv-cinder-820027-21-smb devstack@keystone.service[93151]: pcre jit disabled Sep 01 00:15:47.874329 dv-cinder-820027-21-smb devstack@keystone.service[93151]: detected number of CPU cores: 4 Sep 01 00:15:47.874329 dv-cinder-820027-21-smb devstack@keystone.service[93151]: current working directory: / Sep 01 00:15:47.874329 dv-cinder-820027-21-smb devstack@keystone.service[93151]: detected binary path: /usr/bin/uwsgi-core Sep 01 00:15:47.874329 dv-cinder-820027-21-smb devstack@keystone.service[93151]: your processes number limit is 47680 Sep 01 00:15:47.874329 dv-cinder-820027-21-smb devstack@keystone.service[93151]: your memory page size is 4096 bytes Sep 01 00:15:47.874329 dv-cinder-820027-21-smb devstack@keystone.service[93151]: detected max file descriptor number: 2048 Sep 01 00:15:47.874329 dv-cinder-820027-21-smb devstack@keystone.service[93151]: lock engine: pthread robust mutexes Sep 01 00:15:47.874749 dv-cinder-820027-21-smb devstack@keystone.service[93151]: thunder lock: enabled Sep 01 00:15:47.874749 dv-cinder-820027-21-smb devstack@keystone.service[93151]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 00:15:47.874749 dv-cinder-820027-21-smb devstack@keystone.service[93151]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 00:15:47.913364 dv-cinder-820027-21-smb devstack@keystone.service[93151]: Python main interpreter initialized at 0x5579876e69c0 Sep 01 00:15:47.913364 dv-cinder-820027-21-smb devstack@keystone.service[93151]: python threads support enabled Sep 01 00:15:47.913364 dv-cinder-820027-21-smb devstack@keystone.service[93151]: your server socket listen backlog is limited to 100 connections Sep 01 00:15:47.913364 dv-cinder-820027-21-smb devstack@keystone.service[93151]: your mercy for graceful operations on workers is 90 seconds Sep 01 00:15:47.913680 dv-cinder-820027-21-smb devstack@keystone.service[93151]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 00:15:47.913784 dv-cinder-820027-21-smb devstack@keystone.service[93151]: *** Operational MODE: preforking *** Sep 01 00:15:47.914081 dv-cinder-820027-21-smb devstack@keystone.service[93151]: *** uWSGI is running in multiple interpreter mode *** Sep 01 00:15:47.914081 dv-cinder-820027-21-smb devstack@keystone.service[93151]: spawned uWSGI master process (pid: 93151) Sep 01 00:15:47.914283 dv-cinder-820027-21-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 00:15:47.915730 dv-cinder-820027-21-smb devstack@keystone.service[93151]: spawned uWSGI worker 1 (pid: 93163, cores: 1) Sep 01 00:15:47.915730 dv-cinder-820027-21-smb devstack@keystone.service[93151]: spawned uWSGI worker 2 (pid: 93164, cores: 1) Sep 01 00:15:47.915730 dv-cinder-820027-21-smb devstack@keystone.service[93151]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 00:15:52.187221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:15:52.187221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: from cryptography.utils import int_from_bytes Sep 01 00:15:52.188017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:15:52.188017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: from cryptography.utils import int_from_bytes Sep 01 00:15:52.188466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:15:52.188466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: from cryptography.utils import int_from_bytes Sep 01 00:15:52.188591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:15:52.188591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: from cryptography.utils import int_from_bytes Sep 01 00:15:52.237177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 00:15:52.237369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 00:15:52.237540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] command line args: [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 00:15:52.237742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 00:15:52.237827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 00:15:52.237937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 00:15:52.238018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ================================================================================ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 00:15:52.238147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] command line args: [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 00:15:52.238228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] admin_token = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.238395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 00:15:52.238483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] config_dir = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.238561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ================================================================================ {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 00:15:52.238640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.238759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] config_source = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.238839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] admin_token = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.238934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] debug = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] config_dir = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] config_source = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] debug = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.239901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] list_limit = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] log_config_append = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.240903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] list_limit = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] log_dir = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] log_config_append = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] log_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] log_dir = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] log_file = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.241980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.242055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.242650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.242777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.242855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.242978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.243900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.244918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.245075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.245344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.245441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.245516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] publish_errors = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.245740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.245864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.245989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] publish_errors = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.246930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] standard_threads = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] standard_threads = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.247917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] use_journal = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] use_json = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] use_stderr = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] use_journal = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] use_syslog = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] use_json = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.248925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.249046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] use_stderr = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.249046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] use_syslog = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.249272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.249393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:15:52.249510 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.249624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.249750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.249878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.249994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.250928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.251967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.252800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.253934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.254964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255305 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.255894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.256973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.257094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.257215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.257336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.257457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.257584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.257741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.258414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.258532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.258645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.258759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.258881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.258997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.259927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.260996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261237 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.261942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.262915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263658 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.263996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.264952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.265882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.266925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.267906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268030 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.268915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.269973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270203 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.270912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.271940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.272901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.273955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.274899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] auth.external = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] auth.external = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.275982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] auth.password = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] auth.token = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] auth.password = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.276934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] auth.token = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.277917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] credential.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.278976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] credential.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.279914 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.280913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.281971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.282923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.283982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.284960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.285976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.286917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.287913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288151 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.288974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.289914 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.290978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.291939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.292896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.293970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.294906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.295979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.296980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.297205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.297322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.297438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.297438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.297656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.297773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.297896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.298860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.299895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.300966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.301999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.302936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.303958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.304074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.304197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.304313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.304466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.305980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.306917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.307961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.308110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.308239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.308356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.308486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.308602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.308717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] role.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.308833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] role.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] role.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] role.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.309973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.310912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311387 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.311982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.312957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.313887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314237 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.314947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.315979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.316920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.317980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.318233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.318233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.318449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.318449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.318672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.318672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.318889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.319931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.320054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.320054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.320833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.320833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.connection = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.321903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.connection = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.322972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.323910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.324988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.325929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.326048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.326163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 00:15:52.326279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.326279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.326279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.326279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:15:52.326279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 00:15:52.350811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.351036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.351258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.351714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.351944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.352452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.359756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.360966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.388310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.388561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.389467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.389698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.441315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.441742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.489573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.489803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.490899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.491135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.649689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.649909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.650127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.650340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.650551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.650762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.656328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.656584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.656806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.657023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.657237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.657450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.673432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.673697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.673874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.674087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.674297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.674414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.674536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.674654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.674770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.674898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.675012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.675175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.675389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.675599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.685511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.686427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.698731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.698915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.699984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.700067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.700196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.700435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 00:15:52.717262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.717471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 00:15:52.717660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.717810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.717893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 00:15:52.718009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 00:15:52.718195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.718279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.718393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 00:15:52.718530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.718785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.718918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.719041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.719190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.719453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.719715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.728800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.729080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.729272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.729357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.729551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.729635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.729823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.730107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.736468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.737004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.739295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.739579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.739861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.739944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.740145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.740231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.740448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.740551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.740712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.740797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.740986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.741069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.741251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.741336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.741520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.741602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.741790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.741904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.742090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.742229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.742511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.742783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.764734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.765478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.766170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.766451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.766923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.767207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.770912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.771195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.771476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.771816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.772103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.772405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.777976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.778259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.778696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.778981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.782133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.782423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.782704 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.782983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.783065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.783254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.783347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.783571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.783859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.784136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.784431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.784709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.784980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.785179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.785471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.785756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.801497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.801776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.802254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.802534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.805713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.806411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.808783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.809080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.809631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.809929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.813367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.814074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.816465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.817266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.819509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.819808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.820093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.820931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.821021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.821220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.821304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.821548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.821632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.821842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.822121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.822399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.837201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.837488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.837759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.838001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.838084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.838286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.838551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.838814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.844630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.845611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.846264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.847112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.847782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.848068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.848674 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.848953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.850686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.850967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.851262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.852313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.852422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.852629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.852725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.853024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.853308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.853600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.863682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.863967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.864251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.864557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.864723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.864844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.865008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.865121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.865387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.865470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.865670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.865954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.866234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.866526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.880603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.881891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.884101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.885308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.886956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.888139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.888373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.889640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.889859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.890140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.890423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.891250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.891533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.891825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.896792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.898165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.898250 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.899692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.901175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.901473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.901764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.902040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.902683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.902984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.903269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.903554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.909822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.910113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.910392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.911273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.911565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.911847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.917707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.917991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.918272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.918551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.918823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.919102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.919378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.919580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 00:15:52.919674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.919864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.919949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.920148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.920230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.920451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.920550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.920714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.920798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.920977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.921064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.921255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.921338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.921529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.921812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.922083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.922355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.922625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.922889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.923157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 00:15:52.956777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5579876e69c0 pid: 93164 (default app) Sep 01 00:15:52.957352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5579876e69c0 pid: 93163 (default app) Sep 01 00:15:52.960078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a968e-e03b-446a-b3a1-10fdc2f9c7dd None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:15:52.960362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a968e-e03b-446a-b3a1-10fdc2f9c7dd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:15:52.960657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a968e-e03b-446a-b3a1-10fdc2f9c7dd None None] PATH_INFO: `/v3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:15:52.964896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Thu Sep 1 00:15:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:15:59.458600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733fe4a-335c-4bdd-a2b2-3e05076a1550 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:15:59.459107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733fe4a-335c-4bdd-a2b2-3e05076a1550 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:15:59.459188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733fe4a-335c-4bdd-a2b2-3e05076a1550 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:15:59.463980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:15:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:15:59.469449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:15:59.469883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:15:59.470017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:15:59.539538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: INFO dbcounter [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] Registered counter for database keystone Sep 01 00:15:59.558185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG oslo_db.sqlalchemy.engines [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:15:59.564351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writer thread running {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:15:59.751514 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG passlib.handlers.bcrypt [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93164) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 00:15:59.751823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG passlib.handlers.bcrypt [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93164) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 00:15:59.809623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:15:59.811195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:15:59.936860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:15:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 01 00:16:00.425597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733fe4a-335c-4bdd-a2b2-3e05076a1550 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:00.495230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: INFO dbcounter [None req-d733fe4a-335c-4bdd-a2b2-3e05076a1550 None None] Registered counter for database keystone Sep 01 00:16:00.515874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG oslo_db.sqlalchemy.engines [None req-d733fe4a-335c-4bdd-a2b2-3e05076a1550 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:16:00.522199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writer thread running {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:16:00.644714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733fe4a-335c-4bdd-a2b2-3e05076a1550 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:00.649435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02eefcb-e9a5-4afb-b9b5-4af0da953567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:00.650055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eefcb-e9a5-4afb-b9b5-4af0da953567 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:00.650329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eefcb-e9a5-4afb-b9b5-4af0da953567 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:00.650595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eefcb-e9a5-4afb-b9b5-4af0da953567 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:00.658503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eefcb-e9a5-4afb-b9b5-4af0da953567 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:00.710130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b02eefcb-e9a5-4afb-b9b5-4af0da953567 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 00:16:00.710467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eefcb-e9a5-4afb-b9b5-4af0da953567 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:00.720169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Sep 1 00:16:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 00:16:00.726139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:00.741260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877607d-2546-4ea3-821d-58f4af826027 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:00.745695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac79de-93bf-447d-8dfd-7b5f81d7c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:00.746783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac79de-93bf-447d-8dfd-7b5f81d7c1af admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:00.747063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac79de-93bf-447d-8dfd-7b5f81d7c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:00.747520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac79de-93bf-447d-8dfd-7b5f81d7c1af admin admin] PATH_INFO: `/v3/projects/00e0be78705643f38f372c4bbaf2a54a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:00.749115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac79de-93bf-447d-8dfd-7b5f81d7c1af admin admin] RBAC: Authorizing `identity:get_project(project_id=00e0be78705643f38f372c4bbaf2a54a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:00.802292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1ac79de-93bf-447d-8dfd-7b5f81d7c1af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 00:16:00.802638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac79de-93bf-447d-8dfd-7b5f81d7c1af admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:00.807202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Sep 1 00:16:00 2022] GET /identity/v3/projects/00e0be78705643f38f372c4bbaf2a54a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:02.686251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0f1a6-6074-4497-9385-ea2ee52e5139 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:02.686744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0f1a6-6074-4497-9385-ea2ee52e5139 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:02.686829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0f1a6-6074-4497-9385-ea2ee52e5139 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:02.690948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:02.696752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ba609-b004-4128-a127-2cd00e0edcf6 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:02.697148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ba609-b004-4128-a127-2cd00e0edcf6 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:02.697307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ba609-b004-4128-a127-2cd00e0edcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:02.717740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-bd1ba609-b004-4128-a127-2cd00e0edcf6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:02.719255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bd1ba609-b004-4128-a127-2cd00e0edcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:02.727043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 00:16:02.996051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0f1a6-6074-4497-9385-ea2ee52e5139 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:03.008738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0f1a6-6074-4497-9385-ea2ee52e5139 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:03.013153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c431c5-2ec1-4cff-ae0e-04aa3ac63343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:03.013749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c431c5-2ec1-4cff-ae0e-04aa3ac63343 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:03.014028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c431c5-2ec1-4cff-ae0e-04aa3ac63343 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:03.014300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c431c5-2ec1-4cff-ae0e-04aa3ac63343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:03.022013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c431c5-2ec1-4cff-ae0e-04aa3ac63343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:03.023791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c431c5-2ec1-4cff-ae0e-04aa3ac63343 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:03.032511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Sep 1 00:16:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:16:03.037852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ba609-b004-4128-a127-2cd00e0edcf6 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:03.046804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ba609-b004-4128-a127-2cd00e0edcf6 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:03.051063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092e707-50ca-4cc5-bda9-6f28bd8ad7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:03.051677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e707-50ca-4cc5-bda9-6f28bd8ad7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:03.051957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e707-50ca-4cc5-bda9-6f28bd8ad7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:03.052231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e707-50ca-4cc5-bda9-6f28bd8ad7d6 admin admin] PATH_INFO: `/v3/users/8f836d711bd446dd99381e699620c0c4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:03.053576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092e707-50ca-4cc5-bda9-6f28bd8ad7d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8f836d711bd446dd99381e699620c0c4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:03.055901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092e707-50ca-4cc5-bda9-6f28bd8ad7d6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:03.057440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Thu Sep 1 00:16:03 2022] GET /identity/v3/users/8f836d711bd446dd99381e699620c0c4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:04.990794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6533c-3431-4c29-bee3-d06df14a30a3 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:04.991335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6533c-3431-4c29-bee3-d06df14a30a3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:04.991335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6533c-3431-4c29-bee3-d06df14a30a3 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:04.993186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:04.998259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3965c4-0868-4485-a7d9-910f5ec88a2d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:04.998681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3965c4-0868-4485-a7d9-910f5ec88a2d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:04.998800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3965c4-0868-4485-a7d9-910f5ec88a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.016952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-df3965c4-0868-4485-a7d9-910f5ec88a2d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:05.018118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-df3965c4-0868-4485-a7d9-910f5ec88a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:05.057953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffb095-8fe1-4b7d-8ed9-c7ed2d3f2daa None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.058237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffb095-8fe1-4b7d-8ed9-c7ed2d3f2daa None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.058507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffb095-8fe1-4b7d-8ed9-c7ed2d3f2daa None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.059804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:05.064842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.065122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.065412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.098378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:05.107659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG passlib.handlers.bcrypt [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93163) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 00:16:05.108055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG passlib.handlers.bcrypt [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93163) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 00:16:05.156891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:05.158444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:05.256678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:05.363459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3965c4-0868-4485-a7d9-910f5ec88a2d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:05.386883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:05.465824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3965c4-0868-4485-a7d9-910f5ec88a2d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:05.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:05.498715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.498996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.499272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.510649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:05.519491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:05.520618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:05.521669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:05.526577 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:05.528694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:05.611394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:05.631487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737812f-e8bc-4b46-80ab-0fcd517ec86a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:05.633084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54acb8-b5eb-41ec-88c4-039061f91f3e None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:05.636080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:05.665049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:05.665737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.665939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.666205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.666870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:05.667164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:05.668589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:05.671466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:05.672691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.672976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.673254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.680904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:05.686332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:05.740803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:05.742323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:05.783294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8a66b-cb41-4899-9c36-829c46bd468d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:05.816399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:05.817036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.817314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.817586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] PATH_INFO: `/v3/users/8f836d711bd446dd99381e699620c0c4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.818702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] RBAC: Authorizing `identity:get_user(user_id=8f836d711bd446dd99381e699620c0c4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:05.820142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:05.821743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 9/16] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:05 2022] GET /identity/v3/users/8f836d711bd446dd99381e699620c0c4 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:05.827273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:05.840431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:05.841847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:05.844659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:05.847329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:05.934590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c3cc0-cfc7-4675-8b37-65a62469bb5a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:05.943367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e45960-73e6-4739-8d0e-041e260088fa None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:05.969419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:05.970036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.970311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.970580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.971675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:05.973152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:05.974674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:05.978281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:05.979141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:05.979420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:05.979691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:05.981998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:05.997929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:05.999424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:16:06.017271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:06.018208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:16:06.019003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:16:06.019003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:16:06.019003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:06.019003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:16:06.024649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:06.061640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:06.080931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:06.082572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a757d0-6821-404b-86d3-b8e7aecca333 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:06.116596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ea826-fa1d-4ba6-968a-0031f6c26b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:06.117270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea826-fa1d-4ba6-968a-0031f6c26b2b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:06.117579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea826-fa1d-4ba6-968a-0031f6c26b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:06.117862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea826-fa1d-4ba6-968a-0031f6c26b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:06.118585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ea826-fa1d-4ba6-968a-0031f6c26b2b None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.domain.id=default, user.id=8f836d711bd446dd99381e699620c0c4) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:06.118892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ea826-fa1d-4ba6-968a-0031f6c26b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:06.120327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ea826-fa1d-4ba6-968a-0031f6c26b2b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:06.126697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a01d-7646-4582-96bd-8565ed94cd54 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:06.126890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Sep 1 00:16:05 2022] GET /identity/v3/role_assignments?user.id=8f836d711bd446dd99381e699620c0c4&scope.domain.id=default&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:06.163672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d96fb8-0ef3-4347-a18f-fc42db5708ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:06.164351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d96fb8-0ef3-4347-a18f-fc42db5708ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:06.164657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d96fb8-0ef3-4347-a18f-fc42db5708ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:06.164925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d96fb8-0ef3-4347-a18f-fc42db5708ef None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:06.165583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d96fb8-0ef3-4347-a18f-fc42db5708ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:06.165884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d96fb8-0ef3-4347-a18f-fc42db5708ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:06.167310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d96fb8-0ef3-4347-a18f-fc42db5708ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:06.186244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:08.112293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fae59-e8b4-412b-90c3-83339df190fe None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:08.113357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fae59-e8b4-412b-90c3-83339df190fe None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:08.113866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fae59-e8b4-412b-90c3-83339df190fe None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:08.115688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:08.121480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ff4e-607f-405d-a512-8d77517fc568 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:08.122305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ff4e-607f-405d-a512-8d77517fc568 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:08.122791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ff4e-607f-405d-a512-8d77517fc568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:08.149498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-3d86ff4e-607f-405d-a512-8d77517fc568 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:08.151058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3d86ff4e-607f-405d-a512-8d77517fc568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:08.246489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:08.563672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed9f9-b72f-4f9b-9785-27353b85efdf None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:08.564285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed9f9-b72f-4f9b-9785-27353b85efdf None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:08.564884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed9f9-b72f-4f9b-9785-27353b85efdf None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:08.566424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:08.572409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d27445-df33-4939-b5e1-f93eddc081c3 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:08.572921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d27445-df33-4939-b5e1-f93eddc081c3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:08.573405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d27445-df33-4939-b5e1-f93eddc081c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:08.599064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-49d27445-df33-4939-b5e1-f93eddc081c3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:08.600606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-49d27445-df33-4939-b5e1-f93eddc081c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:08.658356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:08.691849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 12/25] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:08.767620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed9f9-b72f-4f9b-9785-27353b85efdf None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:08.901023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca744a-dd2d-4993-8d6c-d5bd6dfd3c05 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:08.901631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca744a-dd2d-4993-8d6c-d5bd6dfd3c05 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:08.902104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca744a-dd2d-4993-8d6c-d5bd6dfd3c05 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:08.903648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 13/26] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:08.909309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee6576-54e2-44f4-bf3d-2fb15c1d6f5e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:08.909614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee6576-54e2-44f4-bf3d-2fb15c1d6f5e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:08.909881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee6576-54e2-44f4-bf3d-2fb15c1d6f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:08.938464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed9f9-b72f-4f9b-9785-27353b85efdf None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:08.940862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2aee6576-54e2-44f4-bf3d-2fb15c1d6f5e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:08.942072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2aee6576-54e2-44f4-bf3d-2fb15c1d6f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:08.984715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c873e0-e8b6-483d-96e6-9ae790ebb059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:08.985361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c873e0-e8b6-483d-96e6-9ae790ebb059 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:08.985640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c873e0-e8b6-483d-96e6-9ae790ebb059 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:08.985909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c873e0-e8b6-483d-96e6-9ae790ebb059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.010856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c873e0-e8b6-483d-96e6-9ae790ebb059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b3c873e0-e8b6-483d-96e6-9ae790ebb059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:09.016828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:09.017733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:09.018498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 14/27] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:09.022422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05daec-b17f-441b-984d-f77bcd61b54b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.022422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05daec-b17f-441b-984d-f77bcd61b54b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.022422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05daec-b17f-441b-984d-f77bcd61b54b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.022422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:09.024544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05daec-b17f-441b-984d-f77bcd61b54b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.032700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:09.077051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 14/29] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:09.078196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a672-42f1-440f-baf5-c00b0c470c24 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.078543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a672-42f1-440f-baf5-c00b0c470c24 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.078844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a672-42f1-440f-baf5-c00b0c470c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.125370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-bc96a672-42f1-440f-baf5-c00b0c470c24 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:09.126563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bc96a672-42f1-440f-baf5-c00b0c470c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:09.181132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05daec-b17f-441b-984d-f77bcd61b54b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:09.224048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:09.224787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.225124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.225401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.226245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:09.227190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:09.228987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:09.238887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 15/30] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:09.239519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a672-42f1-440f-baf5-c00b0c470c24 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.250444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 16/31] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:09.261878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.308646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:09.400769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:09.418269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a672-42f1-440f-baf5-c00b0c470c24 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:09.437964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cc09-7134-4dd6-948b-ce48b6c2a7c3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:09.485092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:09.485736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.486010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.486276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.503358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:09.504353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:09.504995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:09.505603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.506118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.506583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] PATH_INFO: `/v3/users/8f836d711bd446dd99381e699620c0c4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.513282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=8f836d711bd446dd99381e699620c0c4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:09.515111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:09.517103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 17/32] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:09 2022] GET /identity/v3/users/8f836d711bd446dd99381e699620c0c4 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:09.522512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:16:09.547004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:09.547929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:16:09.549193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:16:09.549193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:16:09.549193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:09.549193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 16/33] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:09.549193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.639817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499951-42a1-4e2b-82d9-e65844733ef1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:09.659511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:09.672758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734159-ebf8-408c-b7ba-fb5c3bf0a480 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:09.677821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:09.678696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.679196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.680207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.681619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:09.683279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:09.685083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 18/34] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:09.686163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.709542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:09.710071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.710399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.710669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.711941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:09.712728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:09.713359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:09.801267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86bdd-602f-42b2-8d55-40f997edcb18 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:09.838744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:09.839724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:09.840197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:09.840684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:09.841542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:09.842038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:09.843263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 17/35] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Sep 1 00:16:09 2022] POST /identity/v3/roles => generated 219 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:09.844020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:09.844255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.870393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 19/36] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:09.871854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:09.953976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:09.982452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff447bb-ab44-4a77-824f-36d3266f97c9 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:09.999385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e313e6c-64fd-419e-8548-d9e045d165f1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:10.034395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:10.035028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.035312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.035628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.036269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:10.037871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:10.040072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c2b9c-80b1-4d65-a6ed-1cb0191e6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:10.041055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2b9c-80b1-4d65-a6ed-1cb0191e6153 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.041567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2b9c-80b1-4d65-a6ed-1cb0191e6153 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.042038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2b9c-80b1-4d65-a6ed-1cb0191e6153 None admin] PATH_INFO: `/v3/domains/default/users/8f836d711bd446dd99381e699620c0c4/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.045047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c2b9c-80b1-4d65-a6ed-1cb0191e6153 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8f836d711bd446dd99381e699620c0c4, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:10.046729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c2b9c-80b1-4d65-a6ed-1cb0191e6153 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:10.055948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Sep 1 00:16:09 2022] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:10.057169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:10.072536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:10.171090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 20/38] 10.222.0.13 () {58 vars in 1361 bytes} [Thu Sep 1 00:16:09 2022] PUT /identity/v3/domains/default/users/8f836d711bd446dd99381e699620c0c4/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:10.176480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0c2c-223a-4c1e-af91-cbcbf181c12a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.176480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0c2c-223a-4c1e-af91-cbcbf181c12a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.176480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0c2c-223a-4c1e-af91-cbcbf181c12a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.178494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 21/39] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:10.179730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ebb34-166f-49e5-bcea-1411261260ba None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.180552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ebb34-166f-49e5-bcea-1411261260ba None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.180827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ebb34-166f-49e5-bcea-1411261260ba None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 22/40] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:10.188125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84811a-7995-4d57-a3b3-8886762b5652 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.188445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84811a-7995-4d57-a3b3-8886762b5652 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.188710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84811a-7995-4d57-a3b3-8886762b5652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.199010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9549-49ab-4a82-b6cd-479f0ef259d1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:10.213335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0a84811a-7995-4d57-a3b3-8886762b5652 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:10.215620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0a84811a-7995-4d57-a3b3-8886762b5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:10.255129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eeb59-d300-4735-9a48-056c347b8c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:10.256032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eeb59-d300-4735-9a48-056c347b8c02 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.256364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eeb59-d300-4735-9a48-056c347b8c02 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.256617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eeb59-d300-4735-9a48-056c347b8c02 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.257547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eeb59-d300-4735-9a48-056c347b8c02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:10.259150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eeb59-d300-4735-9a48-056c347b8c02 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:10.308975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 19/41] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:16:10 2022] POST /identity/v3/projects => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:10.310334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616a45-7bc0-4c35-bb4b-d60dba82669f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.310638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616a45-7bc0-4c35-bb4b-d60dba82669f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.310908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616a45-7bc0-4c35-bb4b-d60dba82669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.328880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 23/42] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:10.333184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f4616a45-7bc0-4c35-bb4b-d60dba82669f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:10.334827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f4616a45-7bc0-4c35-bb4b-d60dba82669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:10.405031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:10.419456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 20/43] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:10.590475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84811a-7995-4d57-a3b3-8886762b5652 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:10.644314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:10.682732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616a45-7bc0-4c35-bb4b-d60dba82669f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:10.700033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84811a-7995-4d57-a3b3-8886762b5652 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:10.798580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616a45-7bc0-4c35-bb4b-d60dba82669f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:10.834809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7d9f7-ad96-4e48-8769-7c406c2ddbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:10.835422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d9f7-ad96-4e48-8769-7c406c2ddbac None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.835706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d9f7-ad96-4e48-8769-7c406c2ddbac None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.836009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d9f7-ad96-4e48-8769-7c406c2ddbac None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.836712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7d9f7-ad96-4e48-8769-7c406c2ddbac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:10.838119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7d9f7-ad96-4e48-8769-7c406c2ddbac None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:10.843684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:10.844325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:10.844639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:10.844982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:10.846110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:10.847728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:10.849684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 24/44] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:10.856429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 21/45] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Sep 1 00:16:10 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:16:10.857411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:10.973136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003397e-bc7f-48cf-ab27-69e9dfac293a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:10.997852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:11.015905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e4c4-683c-49d7-8abb-c23f3d0e86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:11.016586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e4c4-683c-49d7-8abb-c23f3d0e86e2 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:11.016872 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e4c4-683c-49d7-8abb-c23f3d0e86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:11.017147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e4c4-683c-49d7-8abb-c23f3d0e86e2 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:11.017808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86e4c4-683c-49d7-8abb-c23f3d0e86e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:11.019278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86e4c4-683c-49d7-8abb-c23f3d0e86e2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:11.049192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 25/46] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:16:10 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:12.191721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fe33-acb6-4f00-a3e2-b8c1d7f908fc None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:12.192253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fe33-acb6-4f00-a3e2-b8c1d7f908fc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:12.192253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fe33-acb6-4f00-a3e2-b8c1d7f908fc None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:12.193631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 22/47] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:12.198936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab8d90-c335-4f4b-857e-62cf85244be6 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:12.199349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab8d90-c335-4f4b-857e-62cf85244be6 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:12.199517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab8d90-c335-4f4b-857e-62cf85244be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:12.217506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7eab8d90-c335-4f4b-857e-62cf85244be6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:12.218696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7eab8d90-c335-4f4b-857e-62cf85244be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:12.283088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 26/48] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:12.552827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8fe33-acb6-4f00-a3e2-b8c1d7f908fc None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:12.603773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:12.654717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8fe33-acb6-4f00-a3e2-b8c1d7f908fc None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:12.687145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:12.687772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:12.688051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:12.688322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:12.699671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:12.705732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:12.706570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:12.707331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 23/49] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:12.713249 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab8d90-c335-4f4b-857e-62cf85244be6 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:12.808930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab8d90-c335-4f4b-857e-62cf85244be6 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:12.810362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:12.845895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5967ab-b967-4aee-a5a5-f8a9c9a21c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:12.846509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5967ab-b967-4aee-a5a5-f8a9c9a21c7e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:12.846787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5967ab-b967-4aee-a5a5-f8a9c9a21c7e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:12.847118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5967ab-b967-4aee-a5a5-f8a9c9a21c7e None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:12.847794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5967ab-b967-4aee-a5a5-f8a9c9a21c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:12.848093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5967ab-b967-4aee-a5a5-f8a9c9a21c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:12.849526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5967ab-b967-4aee-a5a5-f8a9c9a21c7e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:12.858046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 27/50] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:12.863576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:12.929394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160ae6-f3ef-49d4-b182-ff0053a3b815 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:12.930211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160ae6-f3ef-49d4-b182-ff0053a3b815 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:12.930490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160ae6-f3ef-49d4-b182-ff0053a3b815 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:12.932583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 28/51] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:12.938853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccde91e-9157-4619-9c7e-be0488d9dfb7 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:12.939140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccde91e-9157-4619-9c7e-be0488d9dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:12.939411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccde91e-9157-4619-9c7e-be0488d9dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:12.956871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-8ccde91e-9157-4619-9c7e-be0488d9dfb7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:12.958054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8ccde91e-9157-4619-9c7e-be0488d9dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:12.963051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f92b8-8832-4576-b506-b9cd2effb72f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:12.973159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:12.998446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:12.999483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:12.999765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:13.000039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] PATH_INFO: `/v3/users/8f836d711bd446dd99381e699620c0c4` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:13.001447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] RBAC: Authorizing `identity:get_user(user_id=8f836d711bd446dd99381e699620c0c4)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:13.002918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:13.004518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 24/52] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:12 2022] GET /identity/v3/users/8f836d711bd446dd99381e699620c0c4 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:13.010052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:13.024266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 29/53] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:13.111508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d15b-9ec2-4a75-90b4-6cae435e9403 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:13.143759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:13.144409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:13.144697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:13.144971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:13.146092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:13.147549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:13.149922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 25/54] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:13.155499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccde91e-9157-4619-9c7e-be0488d9dfb7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:13.246041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:13.252966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccde91e-9157-4619-9c7e-be0488d9dfb7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:13.285871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:13.286475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:13.286758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:13.287031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:13.287755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.domain.id=default, user.id=8f836d711bd446dd99381e699620c0c4) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:13.288065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:13.289628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:13.295521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 30/55] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Sep 1 00:16:13 2022] GET /identity/v3/role_assignments?user.id=8f836d711bd446dd99381e699620c0c4&scope.domain.id=default&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:13.296946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:13.453863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:13.507272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8f619-6b3d-4b3b-a2f6-118f0ed102f7 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:13.544833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c01d50-26cd-48a1-b227-9ae6da892356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:13.545463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01d50-26cd-48a1-b227-9ae6da892356 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:13.545743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01d50-26cd-48a1-b227-9ae6da892356 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:13.546022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01d50-26cd-48a1-b227-9ae6da892356 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:13.547110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c01d50-26cd-48a1-b227-9ae6da892356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:13.548636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c01d50-26cd-48a1-b227-9ae6da892356 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:13.550191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 26/56] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:13.556234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:13.653791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc97a2-0455-4c5d-8d23-8051670f61c4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:13.686320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a92cdd-6d32-44a8-a368-9feff9d26add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:13.686914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a92cdd-6d32-44a8-a368-9feff9d26add None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:13.687197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a92cdd-6d32-44a8-a368-9feff9d26add None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:13.687473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a92cdd-6d32-44a8-a368-9feff9d26add None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:13.688111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a92cdd-6d32-44a8-a368-9feff9d26add None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:13.689589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a92cdd-6d32-44a8-a368-9feff9d26add None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:13.714510 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 31/57] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Sep 1 00:16:13 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:15.610371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c862e90-3ef0-4de4-9d2a-2a13812d2669 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:15.610859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c862e90-3ef0-4de4-9d2a-2a13812d2669 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:15.610946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c862e90-3ef0-4de4-9d2a-2a13812d2669 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:15.612239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 27/58] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:15.617249 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4778dfc-23c7-45b4-b688-728a8579a22b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:15.617641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4778dfc-23c7-45b4-b688-728a8579a22b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:15.617791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4778dfc-23c7-45b4-b688-728a8579a22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:15.635203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f4778dfc-23c7-45b4-b688-728a8579a22b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:15.636363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f4778dfc-23c7-45b4-b688-728a8579a22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:15.639052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:15.703101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 32/59] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:15.967802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c862e90-3ef0-4de4-9d2a-2a13812d2669 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:16.065966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c862e90-3ef0-4de4-9d2a-2a13812d2669 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:16.080259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:16.099825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a8fdd-25eb-4ef6-85e3-3e68362fd18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:16.100476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a8fdd-25eb-4ef6-85e3-3e68362fd18b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:16.100758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a8fdd-25eb-4ef6-85e3-3e68362fd18b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:16.101033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a8fdd-25eb-4ef6-85e3-3e68362fd18b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:16.102636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a8fdd-25eb-4ef6-85e3-3e68362fd18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:16.104365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a8fdd-25eb-4ef6-85e3-3e68362fd18b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:16.105942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 28/60] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:16.111331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4778dfc-23c7-45b4-b688-728a8579a22b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:16.206536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4778dfc-23c7-45b4-b688-728a8579a22b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:16.239224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12428e-83de-4288-b3e7-6a48f89d6ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:16.239766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12428e-83de-4288-b3e7-6a48f89d6ca6 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:16.240043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12428e-83de-4288-b3e7-6a48f89d6ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:16.240314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12428e-83de-4288-b3e7-6a48f89d6ca6 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:16.240992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12428e-83de-4288-b3e7-6a48f89d6ca6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:16.243047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12428e-83de-4288-b3e7-6a48f89d6ca6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:16.259283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:16.269685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 33/61] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:16:16 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:19.207393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce12e8-3e6a-4a25-a431-c37b25096aee None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:19.207898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce12e8-3e6a-4a25-a431-c37b25096aee None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:19.207898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce12e8-3e6a-4a25-a431-c37b25096aee None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:19.209312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 29/62] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:19.214651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb9dc-d18e-4b07-87e9-5a1613337d9c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:19.215193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb9dc-d18e-4b07-87e9-5a1613337d9c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:19.215384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb9dc-d18e-4b07-87e9-5a1613337d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:19.238154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-49beb9dc-d18e-4b07-87e9-5a1613337d9c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:19.239366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-49beb9dc-d18e-4b07-87e9-5a1613337d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:19.326405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 34/63] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:19.431484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51c0e-5b20-4cb2-aebc-3709e6a29395 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:19.431484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51c0e-5b20-4cb2-aebc-3709e6a29395 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:19.431484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51c0e-5b20-4cb2-aebc-3709e6a29395 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:19.432139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 30/64] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:19.436528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf05f96-5c36-44e4-b2df-349cabb6a50f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:19.436821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf05f96-5c36-44e4-b2df-349cabb6a50f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:19.437102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf05f96-5c36-44e4-b2df-349cabb6a50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:19.461435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-8cf05f96-5c36-44e4-b2df-349cabb6a50f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:19.462565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8cf05f96-5c36-44e4-b2df-349cabb6a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:19.561631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 35/65] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:19.570761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d6658-ded1-44c2-a6b4-ed4b2b9ddc8b None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:19.571053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d6658-ded1-44c2-a6b4-ed4b2b9ddc8b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:19.571333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d6658-ded1-44c2-a6b4-ed4b2b9ddc8b None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:19.572706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 31/66] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:19.581178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75117147-3680-46f4-8919-698bd09ad85d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:19.581466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75117147-3680-46f4-8919-698bd09ad85d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:19.581745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75117147-3680-46f4-8919-698bd09ad85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:19.615143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-75117147-3680-46f4-8919-698bd09ad85d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:19.616354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-75117147-3680-46f4-8919-698bd09ad85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:19.650278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d6658-ded1-44c2-a6b4-ed4b2b9ddc8b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:19.705853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:19.750113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 36/67] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:19.800351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d6658-ded1-44c2-a6b4-ed4b2b9ddc8b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:19.833199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75117147-3680-46f4-8919-698bd09ad85d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:19.848832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:19.849952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:19.850241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:19.850520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:19.871909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:19.879556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:19.880418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:19.881184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:19.886908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 32/68] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:16:19.892855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:19.941002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:19.971276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75117147-3680-46f4-8919-698bd09ad85d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.006297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28832c4a-48b4-4e6b-92da-42a5ceb89587 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.012454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c417ad4-d450-4a3e-98e0-d6a3b54710c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.013152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417ad4-d450-4a3e-98e0-d6a3b54710c5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.013435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417ad4-d450-4a3e-98e0-d6a3b54710c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.013708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417ad4-d450-4a3e-98e0-d6a3b54710c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.027785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c417ad4-d450-4a3e-98e0-d6a3b54710c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-6c417ad4-d450-4a3e-98e0-d6a3b54710c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:20.034473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:20.035310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:20.036079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:20.037377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 37/69] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:16:20.038440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795894c4-2b2a-437b-a414-5b807e1edd27 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.038741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795894c4-2b2a-437b-a414-5b807e1edd27 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.039071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795894c4-2b2a-437b-a414-5b807e1edd27 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.040603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 38/70] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:20.042477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5d2b6-07cb-458d-838f-d7738670ddbf None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.042764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5d2b6-07cb-458d-838f-d7738670ddbf None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.043064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5d2b6-07cb-458d-838f-d7738670ddbf None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.044501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 39/71] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:20.048968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5d2b6-07cb-458d-838f-d7738670ddbf None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.049462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3a317-5fb2-4b84-819c-95d8a01b70d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.050076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3a317-5fb2-4b84-819c-95d8a01b70d5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.050357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3a317-5fb2-4b84-819c-95d8a01b70d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.050631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3a317-5fb2-4b84-819c-95d8a01b70d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.051300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3a317-5fb2-4b84-819c-95d8a01b70d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:20.051728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3a317-5fb2-4b84-819c-95d8a01b70d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:20.053184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3a317-5fb2-4b84-819c-95d8a01b70d5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:20.066675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 33/72] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:20.067673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d89b1-bb16-4c56-a5bc-c2bb80ef0e6f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.067959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d89b1-bb16-4c56-a5bc-c2bb80ef0e6f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.068235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d89b1-bb16-4c56-a5bc-c2bb80ef0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.086647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-712d89b1-bb16-4c56-a5bc-c2bb80ef0e6f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:20.087829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-712d89b1-bb16-4c56-a5bc-c2bb80ef0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:20.104591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.158728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5d2b6-07cb-458d-838f-d7738670ddbf None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.159657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 34/73] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:20.168573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5e2d-0e58-4dbb-baae-e585268ed67d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.168573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5e2d-0e58-4dbb-baae-e585268ed67d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.168573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5e2d-0e58-4dbb-baae-e585268ed67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.179381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-493f5e2d-0e58-4dbb-baae-e585268ed67d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:20.180631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-493f5e2d-0e58-4dbb-baae-e585268ed67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:20.194611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.195252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.195532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.195804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.196495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:20.196798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:20.198180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:20.206393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 40/74] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:20.208013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.212226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.251778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 35/75] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:20.252730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5e2d-0e58-4dbb-baae-e585268ed67d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.320045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2b622-9c4f-405e-890a-aec6666065c4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.330665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.358507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.359451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.359992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.360467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.382219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:20.385287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:20.387405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 41/76] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:20.388196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.392038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5e2d-0e58-4dbb-baae-e585268ed67d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.431594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.432229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.432617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.432945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.443906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:20.449306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:20.450159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:20.450933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 36/77] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:20.451561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.483320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.495251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad3ef-ec22-4983-b311-9465c80e6e94 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.535100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.535742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.536028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.536307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.537473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:20.539441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:20.541059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 42/78] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:20.541825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.561430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63b43-7dc2-473d-93af-d089b9d2290a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.576739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.595423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.596027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.596307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.596608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.645732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb98af-67b6-4dc9-8ac3-5035a9e5dd0f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.662053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:20.663544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:20.681728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.682437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.682726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.682999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.687679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.693346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:20.698287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:20.699259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:20.700046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 43/79] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:20.700724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.764634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 37/80] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:20.765388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.801905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.810224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6abcee-d9ed-4597-b4b6-0bbacc0f3b7c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.843896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.844492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.844775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.845049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.845710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:20.846012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:20.847413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:20.856157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 44/81] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:20.856976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.864013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cc9a0-e955-4628-8a1e-11a193decd52 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.887604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:20.899381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.900006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.900293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.900597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:20.901713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:20.903175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:20.904781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 38/82] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:20.905587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:20.959012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507686-4176-475f-ad6b-4229378e2fee None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:20.993408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:20.993823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:20.994001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:20.994275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.002278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f856d20-c927-41bd-8eef-5910d9489112 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.018814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.036428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.037035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.037313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.037583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.038240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:21.038541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.040557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.048796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 39/83] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:21.049617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.066625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.068111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.104250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.148142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86378f09-6ba4-4b20-8720-4a88e95c596c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.168297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 45/84] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:21.169183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.182448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.183079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.183360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.183636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.184805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.186251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.187872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 40/85] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:21 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:21.188635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.228256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.271918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a5946-8816-4be5-bdf6-7f00731bf796 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.288833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c67e8-3437-412d-8abb-27fa0f18cc41 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.305866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.306496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.306777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.307053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] PATH_INFO: `/v3/users/8f836d711bd446dd99381e699620c0c4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.308177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=8f836d711bd446dd99381e699620c0c4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.309673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.310746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.311245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 46/86] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:21 2022] GET /identity/v3/users/8f836d711bd446dd99381e699620c0c4 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:21.312015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.326980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.327586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.327866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.328146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.328830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.330262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.356691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 41/87] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:16:21 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:21.357342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.433936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455d191-c844-4fee-9bb4-107d537a5ff2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.459760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.472768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.473422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.473707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.473990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.475151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.476395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c356-0852-48d9-be10-8127528ee5fe None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.477254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.479356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 47/88] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:21 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:21.481274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.528144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.528508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.528788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.529074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.530791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.532526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.536468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 42/89] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:21 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:21.536468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.597159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.600377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df14fb-ee25-486a-8071-738ee2f87b44 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.646379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.647326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.647943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.648829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.649677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=cf36f62c4afc473fb33769cbc076b8a5) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:21.649991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.651659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.660631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 48/90] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:21 2022] GET /identity/v3/role_assignments?user.id=cf36f62c4afc473fb33769cbc076b8a5&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=42931b58092d490eb3e62614a2778775 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:21.660631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:21.663697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21b84-564a-4064-a865-600f548c8d27 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.706143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.706769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.707051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.707540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.739236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.800368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.805974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:21.810220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05368206-e4d1-4d41-891b-d400316c7573 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:21.872542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:21.873168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:21.873448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:21.873723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:21.904489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:21.992581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:21.994074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:22.006579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 43/91] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:22.007243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:22.114340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:22.124154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065a90e-4734-4a6a-a4b3-b6b9fc32d7e7 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:22.192719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 49/92] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:22.193600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:22.195697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:22.196329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:22.196627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:22.196901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:22.197701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] RBAC: Adding query filter params (role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=cf36f62c4afc473fb33769cbc076b8a5) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:22.198055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:22.199614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:22.215147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 44/93] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:22 2022] GET /identity/v3/role_assignments?user.id=cf36f62c4afc473fb33769cbc076b8a5&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:22.215997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:22.240828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:22.361861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d6074-ffcf-4719-b427-6b680652c651 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:22.401840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3fcd7-478a-4854-8cd5-6b02ac1d71ff None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:22.409450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:22.410097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:22.410380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:22.410656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] PATH_INFO: `/v3/projects/947e079a1263461da06848e68a78f718` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:22.411861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] RBAC: Authorizing `identity:get_project(project_id=947e079a1263461da06848e68a78f718)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:22.416413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:22.417929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 45/94] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:22 2022] GET /identity/v3/projects/947e079a1263461da06848e68a78f718 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:22.426096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:22.515863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:22.540416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd6467-1cac-40ab-84b6-e51718ca4972 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:22.545853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:22.547096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:22.547096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:22.547096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:22.549722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:22.551206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:22.557063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 50/95] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:22 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:22.563666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:22.575479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafafdcf-e4e6-4bf8-9162-5cd514d327b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:22.576090 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafdcf-e4e6-4bf8-9162-5cd514d327b8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:22.576366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafdcf-e4e6-4bf8-9162-5cd514d327b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:22.578871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafdcf-e4e6-4bf8-9162-5cd514d327b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:22.578871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafafdcf-e4e6-4bf8-9162-5cd514d327b8 None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, scope.project.id=947e079a1263461da06848e68a78f718, user.id=cf36f62c4afc473fb33769cbc076b8a5) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:22.578871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafafdcf-e4e6-4bf8-9162-5cd514d327b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:22.579664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafafdcf-e4e6-4bf8-9162-5cd514d327b8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:22.588589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 46/96] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:22 2022] GET /identity/v3/role_assignments?user.id=cf36f62c4afc473fb33769cbc076b8a5&scope.project.id=947e079a1263461da06848e68a78f718&role.id=42931b58092d490eb3e62614a2778775 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:22.641847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:22.776821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215da218-0e15-420b-ae65-1e667e06c763 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:22.816246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b057132-9409-4f76-b2d6-bbd7a4d47179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:22.820666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057132-9409-4f76-b2d6-bbd7a4d47179 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:22.820666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057132-9409-4f76-b2d6-bbd7a4d47179 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:22.820666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057132-9409-4f76-b2d6-bbd7a4d47179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:22.820666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b057132-9409-4f76-b2d6-bbd7a4d47179 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=8f836d711bd446dd99381e699620c0c4) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:22.820666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b057132-9409-4f76-b2d6-bbd7a4d47179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:22.820666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b057132-9409-4f76-b2d6-bbd7a4d47179 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:22.829702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 51/97] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:22 2022] GET /identity/v3/role_assignments?user.id=8f836d711bd446dd99381e699620c0c4&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:23.915089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a00789-b682-4cec-bb1a-f4d64b324fe2 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:23.915089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a00789-b682-4cec-bb1a-f4d64b324fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:23.915089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a00789-b682-4cec-bb1a-f4d64b324fe2 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:23.916142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 47/98] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:23.920150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d380a-1ca0-407f-82b8-7dcb51f002a1 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:23.920978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d380a-1ca0-407f-82b8-7dcb51f002a1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:23.921452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d380a-1ca0-407f-82b8-7dcb51f002a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:23.949287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-008d380a-1ca0-407f-82b8-7dcb51f002a1 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:23.950812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-008d380a-1ca0-407f-82b8-7dcb51f002a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:24.034066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 52/99] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:24.337254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e231-2001-4992-83ef-8bba2a251cff None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:24.337926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e231-2001-4992-83ef-8bba2a251cff None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:24.338409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e231-2001-4992-83ef-8bba2a251cff None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:24.340240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 48/100] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:24.349758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a2be-1bf9-4de1-961e-8126cc484603 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:24.350272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a2be-1bf9-4de1-961e-8126cc484603 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:24.350738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a2be-1bf9-4de1-961e-8126cc484603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:24.373297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3255a2be-1bf9-4de1-961e-8126cc484603 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:24.374765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3255a2be-1bf9-4de1-961e-8126cc484603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:24.389357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:24.463504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 53/101] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:24.465364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5de12-68d8-4a55-a1ff-a6c36ce24841 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:24.465844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5de12-68d8-4a55-a1ff-a6c36ce24841 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:24.466344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5de12-68d8-4a55-a1ff-a6c36ce24841 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:24.467864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 49/102] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:24.472837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d97593-b0eb-4fa6-8017-88250fe7d15c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:24.473325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d97593-b0eb-4fa6-8017-88250fe7d15c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:24.473796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d97593-b0eb-4fa6-8017-88250fe7d15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:24.500638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-54d97593-b0eb-4fa6-8017-88250fe7d15c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:24.502188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-54d97593-b0eb-4fa6-8017-88250fe7d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:24.525901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255a2be-1bf9-4de1-961e-8126cc484603 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:24.646625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 50/103] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:24.726254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255a2be-1bf9-4de1-961e-8126cc484603 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:24.771842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:24.772868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:24.773888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:24.774360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:24.793320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:24.798484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:24.799339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:24.800132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:24.802420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 54/104] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:16:24.808835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d97593-b0eb-4fa6-8017-88250fe7d15c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:24.897505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:24.922175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:24.934592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:24.943233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d97593-b0eb-4fa6-8017-88250fe7d15c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.024347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:25.025005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.025287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.025559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.026238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:25.026542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:25.027937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:25.054314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 51/105] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:25.059849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:25.084186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50471c-68ae-4387-8aa6-809b83ab79cd None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.131246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:25.132046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.132585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.133384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.134521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:25.136641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:25.138139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 55/106] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:25.144073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:25.239731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:25.240907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774a8e4-2062-42ad-a381-2c7f80367f2b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.282068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6457a6-efbf-4216-b668-52142215b24d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.283062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:25.283760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.284103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.284480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] PATH_INFO: `/v3/users/d02ee47742564ff4baa82065ad04fbea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.286861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:25.302368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] RBAC: Authorizing `identity:get_user(user_id=d02ee47742564ff4baa82065ad04fbea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:25.303974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:25.306319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 52/107] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:25 2022] GET /identity/v3/users/d02ee47742564ff4baa82065ad04fbea => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:25.307226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:25.327619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ae8fe-e70a-4c2a-aec5-5daa95e54dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:25.328235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae8fe-e70a-4c2a-aec5-5daa95e54dfa None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.328546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae8fe-e70a-4c2a-aec5-5daa95e54dfa None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.328827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae8fe-e70a-4c2a-aec5-5daa95e54dfa None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.330005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ae8fe-e70a-4c2a-aec5-5daa95e54dfa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:25.331761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ae8fe-e70a-4c2a-aec5-5daa95e54dfa None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:25.372926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 56/108] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:16:25 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:16:25.382663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce0089-c181-4725-b6eb-9d58cc82b128 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.383050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce0089-c181-4725-b6eb-9d58cc82b128 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.383328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce0089-c181-4725-b6eb-9d58cc82b128 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.391939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 57/109] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:25 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:25.393607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce0089-c181-4725-b6eb-9d58cc82b128 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:25.480350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31704-f862-4426-8620-db991ad0ff15 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.557054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264a5b-6969-46c4-a791-3d8f321edffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:25.557691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264a5b-6969-46c4-a791-3d8f321edffe None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.558200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264a5b-6969-46c4-a791-3d8f321edffe None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.558669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264a5b-6969-46c4-a791-3d8f321edffe None admin] PATH_INFO: `/v3/roles/member` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.572357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3264a5b-6969-46c4-a791-3d8f321edffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-b3264a5b-6969-46c4-a791-3d8f321edffe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:25.577825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:25.578732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:25.579510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:25.580082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce0089-c181-4725-b6eb-9d58cc82b128 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.581852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 53/110] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:25.589502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4201e-39e1-41c7-8559-6a6f99509526 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.590072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4201e-39e1-41c7-8559-6a6f99509526 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.590543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4201e-39e1-41c7-8559-6a6f99509526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.609762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1aa4201e-39e1-41c7-8559-6a6f99509526 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:25.611261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1aa4201e-39e1-41c7-8559-6a6f99509526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:25.613029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:25.625769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9793fc-1a1d-462a-9fe2-2ae38848ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:25.626446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9793fc-1a1d-462a-9fe2-2ae38848ee4a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.626786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9793fc-1a1d-462a-9fe2-2ae38848ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.627065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9793fc-1a1d-462a-9fe2-2ae38848ee4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.682155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:25.709871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 54/111] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:25.711733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4201e-39e1-41c7-8559-6a6f99509526 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:25.718667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9793fc-1a1d-462a-9fe2-2ae38848ee4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:25.720337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9793fc-1a1d-462a-9fe2-2ae38848ee4a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:25.827224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 58/112] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:25.828912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b208bd-a241-4072-a5a0-b84e6d4ed1b9 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.829415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b208bd-a241-4072-a5a0-b84e6d4ed1b9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.829880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b208bd-a241-4072-a5a0-b84e6d4ed1b9 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.831377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 59/113] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:25.832586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e42265-3253-4eef-8b5f-1cbbbe4a35a7 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.833071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e42265-3253-4eef-8b5f-1cbbbe4a35a7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.833536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e42265-3253-4eef-8b5f-1cbbbe4a35a7 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.834923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 60/114] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:25.835902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e42265-3253-4eef-8b5f-1cbbbe4a35a7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:25.849231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4201e-39e1-41c7-8559-6a6f99509526 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.875221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:25.891213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b351b-3ec5-4e83-9067-28974f70e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:25.892146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b351b-3ec5-4e83-9067-28974f70e300 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.892649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b351b-3ec5-4e83-9067-28974f70e300 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.893165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b351b-3ec5-4e83-9067-28974f70e300 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.894077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b351b-3ec5-4e83-9067-28974f70e300 None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:25.894613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b351b-3ec5-4e83-9067-28974f70e300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:25.896370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b351b-3ec5-4e83-9067-28974f70e300 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:25.907120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 55/115] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:25.908731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d3a0-6f89-4587-86b4-758dc8656278 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:25.909210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d3a0-6f89-4587-86b4-758dc8656278 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:25.909670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d3a0-6f89-4587-86b4-758dc8656278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:25.929139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6ba4d3a0-6f89-4587-86b4-758dc8656278 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:25.930707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6ba4d3a0-6f89-4587-86b4-758dc8656278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:25.967076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e42265-3253-4eef-8b5f-1cbbbe4a35a7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:25.977696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:26.008592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 56/116] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:26.009910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75171a01-1520-45de-af57-140d716f5770 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.010220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75171a01-1520-45de-af57-140d716f5770 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.010514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75171a01-1520-45de-af57-140d716f5770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.018894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.019824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.020279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.020788 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.022121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:26.024282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:26.026171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 61/117] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:25 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:26.027104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.033733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-75171a01-1520-45de-af57-140d716f5770 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:26.035221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-75171a01-1520-45de-af57-140d716f5770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:26.124236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 57/118] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:26.125588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75171a01-1520-45de-af57-140d716f5770 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.133451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:26.145551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9043892-54e3-4b7b-ae8a-739af1e2d059 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.206066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.206709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.206985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.207257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.209473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:26.210959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:26.215970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 62/119] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:26.216779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.303198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75171a01-1520-45de-af57-140d716f5770 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.307251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:26.352243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.352938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.353469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.353732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.363912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:26.369013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:26.369969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:26.370734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 58/120] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:26.371360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.378800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946af5-a161-4b90-a3d1-dc94edf7b44a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.424588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.425406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.426326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.426747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.427923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] RBAC: Adding query filter params (role.id=83f47e3fe65f49a0b3edb0d175242e96, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=d02ee47742564ff4baa82065ad04fbea) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:26.428374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:26.431469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:26.439232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 63/121] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/role_assignments?user.id=d02ee47742564ff4baa82065ad04fbea&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=83f47e3fe65f49a0b3edb0d175242e96 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:26.440556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.493690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276387-2ed5-4704-ae7f-160b5ef40bff None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.494001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:26.532065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.533165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.533720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.533997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.535424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:26.537785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:26.540557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 59/122] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:26.541456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.587858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:26.593610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a3fe2-9663-4f95-ac4d-3a350defd26b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.636294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.637314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.638199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.638704 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.652209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:26.659871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:26.660769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:26.661538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:26.662213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 64/123] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:26.668417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.671349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74a02-c464-4c37-8afb-95e2e0a64a40 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.712017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.714024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.714534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.715042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.715927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:26.716472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:26.718695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:26.730565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 60/124] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:26.731798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.786054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:26.800060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac411b-11bc-4bd4-828e-130c5fef098e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.837726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.838447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.838731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.839004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.850549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:26.855445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:26.857371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:26.858446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 65/125] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:26.864144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.872581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f4d45-7636-481c-95b3-f19908f36a63 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:26.918512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:26.919398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:26.919825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:26.920245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea/users/cf36f62c4afc473fb33769cbc076b8a5/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:26.923194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] RBAC: Authorizing `identity:create_grant(project_id=06ab6cdbc24841e085a006b817751fea, user_id=cf36f62c4afc473fb33769cbc076b8a5, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:26.925794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:26.945563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 61/126] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:26 2022] PUT /identity/v3/projects/06ab6cdbc24841e085a006b817751fea/users/cf36f62c4afc473fb33769cbc076b8a5/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:26.947296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:26.975389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e2c7d-d9f7-4a8b-ad08-29aa1fd8acfc None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.017987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.018681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.019018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.019298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.019986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:27.020292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.021750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.037720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 66/127] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.039490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.058087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:27.094720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a04cd3-a04e-47a0-99e7-76313607c50a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.131991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.133382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.134417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.134417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.135496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.137078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.138931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 62/128] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:26 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.139647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.166984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:27.171549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a9eb-4857-446e-adac-a07fb7837c79 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.212248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.213260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.213746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.214222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.215178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:27.215771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.217433 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.227689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 67/129] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.233599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.256179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce3b0e-2660-484a-8ce7-843d63cae117 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.310992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:27.315706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.316713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.316823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.317164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] PATH_INFO: `/v3/users/8f836d711bd446dd99381e699620c0c4` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.318345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] RBAC: Authorizing `identity:get_user(user_id=8f836d711bd446dd99381e699620c0c4)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.319841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.322012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 63/130] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:27 2022] GET /identity/v3/users/8f836d711bd446dd99381e699620c0c4 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.322821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.344859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f409b-0dbb-410a-a74a-b414a13c7ee7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.380908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.381979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.382479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.383556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.384953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.386614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.388793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 68/131] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:27 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.389869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.518194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:27.533919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b39c2-544f-4f22-be13-1d53a0ea936a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.572815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.573824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.574327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.574805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.576245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.578290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.580672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 64/132] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:27 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.585338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.595076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5bb45-9fe6-467f-a0bc-e30f0f6e6931 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.632033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.632871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.633153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.633428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.634643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.636201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.638056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 69/133] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:27 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.638602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.672783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:27.752958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284db67d-8cde-4464-ae68-4139ac99d284 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.785629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d384d59-eab0-4000-929c-7dfc99f7bed9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:27.789737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.790748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.791231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.791728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea/users/cf36f62c4afc473fb33769cbc076b8a5/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.794394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] RBAC: Authorizing `identity:create_grant(project_id=06ab6cdbc24841e085a006b817751fea, user_id=cf36f62c4afc473fb33769cbc076b8a5, role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.796172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.816214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 65/134] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:27 2022] PUT /identity/v3/projects/06ab6cdbc24841e085a006b817751fea/users/cf36f62c4afc473fb33769cbc076b8a5/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:27.817439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.840190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e96e-5907-4088-93f1-a40a60fad30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:27.841537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e96e-5907-4088-93f1-a40a60fad30e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.842043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e96e-5907-4088-93f1-a40a60fad30e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.842980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:27.844079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e96e-5907-4088-93f1-a40a60fad30e None admin] PATH_INFO: `/v3/projects/947e079a1263461da06848e68a78f718` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.845726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e96e-5907-4088-93f1-a40a60fad30e None admin] RBAC: Authorizing `identity:get_project(project_id=947e079a1263461da06848e68a78f718)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:27.849393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e96e-5907-4088-93f1-a40a60fad30e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:27.853409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 70/135] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:27 2022] GET /identity/v3/projects/947e079a1263461da06848e68a78f718 => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:27.854832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86f62d-057d-4729-a072-7694efec290d None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:27.855315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86f62d-057d-4729-a072-7694efec290d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:27.855730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86f62d-057d-4729-a072-7694efec290d None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:27.857118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 71/136] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:27.860159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86f62d-057d-4729-a072-7694efec290d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:27.955066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:27.973317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a202b-94c1-476b-b4b9-16a628233043 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:28.008688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86f62d-057d-4729-a072-7694efec290d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:28.046338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392158d-0aea-4cfc-b3f7-3ae8964c6996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:28.047407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392158d-0aea-4cfc-b3f7-3ae8964c6996 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:28.047884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392158d-0aea-4cfc-b3f7-3ae8964c6996 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:28.048349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392158d-0aea-4cfc-b3f7-3ae8964c6996 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea/users/8f836d711bd446dd99381e699620c0c4/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:28.050628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392158d-0aea-4cfc-b3f7-3ae8964c6996 None admin] RBAC: Authorizing `identity:create_grant(project_id=06ab6cdbc24841e085a006b817751fea, user_id=8f836d711bd446dd99381e699620c0c4, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:28.052309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392158d-0aea-4cfc-b3f7-3ae8964c6996 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:28.063223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:28.064272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:28.064405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:28.064709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] PATH_INFO: `/v3/projects/947e079a1263461da06848e68a78f718/users/cf36f62c4afc473fb33769cbc076b8a5/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:28.066961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=947e079a1263461da06848e68a78f718, user_id=cf36f62c4afc473fb33769cbc076b8a5, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:28.068595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:28.069611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 66/137] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:27 2022] PUT /identity/v3/projects/06ab6cdbc24841e085a006b817751fea/users/8f836d711bd446dd99381e699620c0c4/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:28.071769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e73d8e-2aef-4da6-b133-efec2765d471 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:28.072309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e73d8e-2aef-4da6-b133-efec2765d471 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:28.072838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e73d8e-2aef-4da6-b133-efec2765d471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:28.097391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 72/138] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:27 2022] PUT /identity/v3/projects/947e079a1263461da06848e68a78f718/users/cf36f62c4afc473fb33769cbc076b8a5/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:28.109003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b6e73d8e-2aef-4da6-b133-efec2765d471 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:28.110424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b6e73d8e-2aef-4da6-b133-efec2765d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:28.190991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 67/139] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:28.614083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:28.735354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae355d3-2c74-48f0-8aa8-b281c4326fe4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:28.770765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:28.771402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:28.771683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:28.771952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:28.773096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:28.774684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:28.776496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 73/140] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:28.781695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:28.782256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb8c2-65b8-4d01-b18a-5b290d68e813 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:28.782551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb8c2-65b8-4d01-b18a-5b290d68e813 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:28.782830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb8c2-65b8-4d01-b18a-5b290d68e813 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:28.784413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 68/141] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:28.785711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:28.790540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77423469-d43a-431d-b0d9-312b7705f704 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:28.790825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77423469-d43a-431d-b0d9-312b7705f704 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:28.791102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77423469-d43a-431d-b0d9-312b7705f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:28.839138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-77423469-d43a-431d-b0d9-312b7705f704 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:28.840360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-77423469-d43a-431d-b0d9-312b7705f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:28.843576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:28.923066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7379a-53a4-4382-82a6-9347a3438cc9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:28.970685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 69/142] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:28.978568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:28.979298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:28.979733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:28.980137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:28.980940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:28.982506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:29.005610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 74/143] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:16:28 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:16:29.361611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77423469-d43a-431d-b0d9-312b7705f704 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:29.467311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77423469-d43a-431d-b0d9-312b7705f704 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:29.506094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a226e0-2132-4d61-a3de-c0f205ca8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:29.506731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a226e0-2132-4d61-a3de-c0f205ca8a81 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:29.507011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a226e0-2132-4d61-a3de-c0f205ca8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:29.507292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a226e0-2132-4d61-a3de-c0f205ca8a81 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:29.515242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:29.519176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a226e0-2132-4d61-a3de-c0f205ca8a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-b3a226e0-2132-4d61-a3de-c0f205ca8a81 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:29.524917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:29.525767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:29.526983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 70/144] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:29.534830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:29.618969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:29.642059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149d9ab-6134-4d6b-8bdf-5fe59b19067c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:29.656338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2e1f-9710-427f-81a1-50b7ed98becc None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:29.656652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2e1f-9710-427f-81a1-50b7ed98becc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:29.656931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2e1f-9710-427f-81a1-50b7ed98becc None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:29.658407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 71/145] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:29.663259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aaabb-53fa-4c36-9813-649b8e29792a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:29.663591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aaabb-53fa-4c36-9813-649b8e29792a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:29.664424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aaabb-53fa-4c36-9813-649b8e29792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:29.686174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ba8aaabb-53fa-4c36-9813-649b8e29792a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:29.687780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ba8aaabb-53fa-4c36-9813-649b8e29792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:29.711081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:29.711707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:29.711987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:29.712255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:29.712950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:29.713248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:29.714661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:29.731855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 75/146] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:29.749901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:29.777446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 72/147] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:29.931748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c75dc-cf71-4d3c-9630-1103735229c9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:29.966165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:29.979365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:29.980010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:29.980290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:29.980588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] PATH_INFO: `/v3/users/d02ee47742564ff4baa82065ad04fbea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:29.981747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] RBAC: Authorizing `identity:get_user(user_id=d02ee47742564ff4baa82065ad04fbea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:29.983221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:29.985148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 76/148] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:29 2022] GET /identity/v3/users/d02ee47742564ff4baa82065ad04fbea => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:29.990509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8aaabb-53fa-4c36-9813-649b8e29792a None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:30.129255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8aaabb-53fa-4c36-9813-649b8e29792a None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:30.170751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:30.171427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:30.171703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:30.171976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:30.172768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:30.173683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:30.175147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:30.177088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 73/149] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:29 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:30.183115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:30.251478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:30.325733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596d1f8-c4e1-4ad6-b7e5-c89d7aeb21ef None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:30.380327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:30.381043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:30.381326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:30.381600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea/users/d02ee47742564ff4baa82065ad04fbea/roles/83f47e3fe65f49a0b3edb0d175242e96` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:30.384455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] RBAC: Authorizing `identity:create_grant(project_id=06ab6cdbc24841e085a006b817751fea, user_id=d02ee47742564ff4baa82065ad04fbea, role_id=83f47e3fe65f49a0b3edb0d175242e96)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:30.385933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:30.386419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426bd7b-fe2c-4981-b42a-7a4d862a5de0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:30.401358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 77/150] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:30 2022] PUT /identity/v3/projects/06ab6cdbc24841e085a006b817751fea/users/d02ee47742564ff4baa82065ad04fbea/roles/83f47e3fe65f49a0b3edb0d175242e96 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:30.426572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:30.427320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:30.427617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:30.427889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] PATH_INFO: `/v3/roles/member` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:30.444928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:30.450500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:30.452893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:30.454521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 74/151] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:16:30.462566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:30.540536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:30.604691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5e1da-0548-4e79-8fb3-41aaf9ffec49 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:30.644014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f699a-e2d6-47ff-b8e9-098fb3f3a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:30.644670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f699a-e2d6-47ff-b8e9-098fb3f3a3fe None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:30.644950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f699a-e2d6-47ff-b8e9-098fb3f3a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:30.645222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f699a-e2d6-47ff-b8e9-098fb3f3a3fe None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:30.645895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f699a-e2d6-47ff-b8e9-098fb3f3a3fe None admin] RBAC: Adding query filter params (name=member) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:30.646197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f699a-e2d6-47ff-b8e9-098fb3f3a3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:30.647669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f699a-e2d6-47ff-b8e9-098fb3f3a3fe None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:30.657029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 78/152] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:30.662807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:30.739933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:30.793562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3697970-70c3-41f4-b738-61f96e95baec None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:30.795135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609976b-ad2e-46b9-87b6-1aad540e8f9e None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:30.795430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609976b-ad2e-46b9-87b6-1aad540e8f9e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:30.795729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609976b-ad2e-46b9-87b6-1aad540e8f9e None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:30.797190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 79/153] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:30.806391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7397d-f045-468d-8555-7915b27d1854 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:30.806683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7397d-f045-468d-8555-7915b27d1854 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:30.806962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7397d-f045-468d-8555-7915b27d1854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:30.829932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:30.830574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:30.830852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:30.831124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:30.832266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:30.833767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:30.835872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 75/154] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:30 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:30.846133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:30.853896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c5b7397d-f045-468d-8555-7915b27d1854 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:30.855187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c5b7397d-f045-468d-8555-7915b27d1854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:30.981884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874ee9f-e47e-4ef9-8654-a85d59682f1d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:31.001930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 80/155] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:31.024020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:31.040043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab15d0-acf1-40be-99a4-7f783d6c219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:31.040693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab15d0-acf1-40be-99a4-7f783d6c219e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.040975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab15d0-acf1-40be-99a4-7f783d6c219e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.041246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab15d0-acf1-40be-99a4-7f783d6c219e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:31.124095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab15d0-acf1-40be-99a4-7f783d6c219e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:31.125586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab15d0-acf1-40be-99a4-7f783d6c219e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:31.250194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 76/156] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:31.255707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7397d-f045-468d-8555-7915b27d1854 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:31.329092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:31.391401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7397d-f045-468d-8555-7915b27d1854 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:31.410658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5aba6-3a0c-4faf-b458-f3a4bb99f759 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.411162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5aba6-3a0c-4faf-b458-f3a4bb99f759 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.411162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5aba6-3a0c-4faf-b458-f3a4bb99f759 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:31.412541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 77/157] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:31.427740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:31.427931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1629-b0d9-4a9a-9972-f2b0c256f204 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.428042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1629-b0d9-4a9a-9972-f2b0c256f204 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.428285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1629-b0d9-4a9a-9972-f2b0c256f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:31.428416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.428680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.428953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:31.430614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:31.432077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:31.433930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 81/158] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:31 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:31.439436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:31.467064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c93d1629-b0d9-4a9a-9972-f2b0c256f204 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:31.468256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c93d1629-b0d9-4a9a-9972-f2b0c256f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:31.505633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:31.548208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dfe98-9c98-451e-b8d0-e7ab6fe49993 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:31.567373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:31.604324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:31.605111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.605393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.605802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:31.606547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=cf36f62c4afc473fb33769cbc076b8a5) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:31.606855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:31.608423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:31.615267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 82/159] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:31 2022] GET /identity/v3/role_assignments?user.id=cf36f62c4afc473fb33769cbc076b8a5&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=42931b58092d490eb3e62614a2778775 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:31.621477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:31.629994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 78/160] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:31.785130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f806c1e-2b59-40cf-963c-94898dea8b73 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:31.838620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313435f-b6df-438f-9112-3019efd7d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:31.839284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313435f-b6df-438f-9112-3019efd7d92a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.839564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313435f-b6df-438f-9112-3019efd7d92a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.839834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313435f-b6df-438f-9112-3019efd7d92a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:31.856866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313435f-b6df-438f-9112-3019efd7d92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-7313435f-b6df-438f-9112-3019efd7d92a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:31.862333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:31.863227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:31.864447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 83/161] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:31.873509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1629-b0d9-4a9a-9972-f2b0c256f204 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:31.977769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c6ba-cf96-4e6d-b922-1504967f0d69 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.978358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c6ba-cf96-4e6d-b922-1504967f0d69 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.978576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c6ba-cf96-4e6d-b922-1504967f0d69 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:31.980171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 84/162] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:31.985449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95169-c8eb-44ca-8ceb-d73e83ccff6c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:31.985732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95169-c8eb-44ca-8ceb-d73e83ccff6c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:31.986004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf95169-c8eb-44ca-8ceb-d73e83ccff6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:32.033391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cbf95169-c8eb-44ca-8ceb-d73e83ccff6c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:32.034609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cbf95169-c8eb-44ca-8ceb-d73e83ccff6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:32.035974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1629-b0d9-4a9a-9972-f2b0c256f204 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:32.096844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:32.097462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:32.097742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:32.098006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:32.098669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:32.098964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:32.100350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:32.104714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:32.115669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 79/163] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:32.122072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:32.162698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:32.170277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 85/164] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:32.281830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0e39a-4a5c-44e5-bdb4-8b7d1a9522d5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:32.311110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf95169-c8eb-44ca-8ceb-d73e83ccff6c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:32.337249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:32.338269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:32.338795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:32.339258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:32.345095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:32.346813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:32.348656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 80/165] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:32 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:32.370814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:32.434991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf95169-c8eb-44ca-8ceb-d73e83ccff6c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:32.471347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:32.472035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:32.472318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:32.472623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:32.484694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:32.492167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:32.493204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:32.494407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 86/166] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:32.502210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:32.541299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:32.543799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:32.578448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5181ed-4b3f-42f7-8084-6b8909da7a4d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:32.624185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9dc54-aa1a-495c-99fe-84f58c3d2116 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:32.631570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:32.632295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:32.633216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:32.633586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:32.677144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:32.678036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:32.678464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:32.678885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:32.679922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:32.680370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:32.682132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:32.696209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 87/167] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:32.706362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:32.760251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:32.761811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:32.854125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:32.876637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:32.890061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab63f-6b6d-4956-83fe-2f50babf8ef7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:32.909123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 81/168] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:32.914726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:32.970844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:32.972969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:32.973653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:32.974824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] PATH_INFO: `/v3/users/8f836d711bd446dd99381e699620c0c4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:32.977071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] RBAC: Authorizing `identity:get_user(user_id=8f836d711bd446dd99381e699620c0c4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:32.980425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:32.983112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 88/169] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:32 2022] GET /identity/v3/users/8f836d711bd446dd99381e699620c0c4 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:32.984685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:33.121184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e9ab6-3637-44e9-baa1-691d2d286f84 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:33.180450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:33.181092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.181363 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.181628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.185060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:33.186513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:33.188153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 82/170] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:32 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:33.188942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:33.212291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b76be-7725-41e6-845d-6846bdd40b35 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:33.269160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:33.290232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:33.291017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.291371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.291715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.311118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:33.316602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:33.317489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:33.318544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 89/171] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:33.319911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:33.339778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27c819-c0e3-4ae6-b321-f7fbadfc2561 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:33.348555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:33.396895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543367-8e1b-423e-8530-6917ebfb15c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:33.398771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543367-8e1b-423e-8530-6917ebfb15c3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.399198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543367-8e1b-423e-8530-6917ebfb15c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.399652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543367-8e1b-423e-8530-6917ebfb15c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.511683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa543367-8e1b-423e-8530-6917ebfb15c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:33.513208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa543367-8e1b-423e-8530-6917ebfb15c3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:33.517809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca12fc-3404-4569-97d1-aaee204627e8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:33.559975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:33.560703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.560989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.561390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.562127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] RBAC: Adding query filter params (role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=cf36f62c4afc473fb33769cbc076b8a5) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:33.562437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:33.563898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:33.570204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 90/172] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:33 2022] GET /identity/v3/role_assignments?user.id=cf36f62c4afc473fb33769cbc076b8a5&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:33.571081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:33.676467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:33.704210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:33.745699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a188ca-feb2-4d02-8e73-a7cbd54e061f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:33.799509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:33.800125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.800455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.800732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 83/173] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:33.800970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.801403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:33.801843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:33.802020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2201467-2847-4122-8efe-3b3a8842f0aa None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.802265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2201467-2847-4122-8efe-3b3a8842f0aa None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.802541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2201467-2847-4122-8efe-3b3a8842f0aa None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.803087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:33.805211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 84/174] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:33.806269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d72b-499a-4eb9-8c35-c030d9921273 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.806613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d72b-499a-4eb9-8c35-c030d9921273 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.806889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d72b-499a-4eb9-8c35-c030d9921273 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.808091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 85/175] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:33.809973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57f8d-56d5-476e-b299-b422ea8a9774 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.810257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57f8d-56d5-476e-b299-b422ea8a9774 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.810522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57f8d-56d5-476e-b299-b422ea8a9774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.821081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 91/176] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:33.821941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:33.837483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-14b57f8d-56d5-476e-b299-b422ea8a9774 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:33.838704 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-14b57f8d-56d5-476e-b299-b422ea8a9774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:33.922641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 86/177] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:33.924105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b9fd-fa03-4371-9660-a22bb3d421c7 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.924412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b9fd-fa03-4371-9660-a22bb3d421c7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.924688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b9fd-fa03-4371-9660-a22bb3d421c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.945620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-aeb0b9fd-fa03-4371-9660-a22bb3d421c7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:33.946811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-aeb0b9fd-fa03-4371-9660-a22bb3d421c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:33.948212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef749d-d5a1-47ea-9fc4-73f4425308f8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:33.993242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:33.993888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:33.994173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:33.994449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:33.995980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:33.998096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:34.000341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 92/178] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:33 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:34.001314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.014776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.029457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 87/179] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:34.035342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b9fd-fa03-4371-9660-a22bb3d421c7 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.061811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.127181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffde94-3c62-4372-bec7-fafcf69cabde None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:34.169697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:34.170350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.170633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.170909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] PATH_INFO: `/v3/users/cf36f62c4afc473fb33769cbc076b8a5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.172058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] RBAC: Authorizing `identity:get_user(user_id=cf36f62c4afc473fb33769cbc076b8a5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:34.173714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:34.176080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 93/180] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/users/cf36f62c4afc473fb33769cbc076b8a5 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:34.184259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.217987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b9fd-fa03-4371-9660-a22bb3d421c7 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:34.272047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8b600-5354-4ffc-84b5-ce79369afbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:34.273604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8b600-5354-4ffc-84b5-ce79369afbfe None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.274161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8b600-5354-4ffc-84b5-ce79369afbfe None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.274632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8b600-5354-4ffc-84b5-ce79369afbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.275620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8b600-5354-4ffc-84b5-ce79369afbfe None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=8f836d711bd446dd99381e699620c0c4) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:34.276152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8b600-5354-4ffc-84b5-ce79369afbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:34.277843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8b600-5354-4ffc-84b5-ce79369afbfe None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:34.284119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 88/181] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/role_assignments?user.id=8f836d711bd446dd99381e699620c0c4&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:34.285721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337074b-cc4d-49d4-a0ef-1622c40ecf1f None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.286222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337074b-cc4d-49d4-a0ef-1622c40ecf1f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.286706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337074b-cc4d-49d4-a0ef-1622c40ecf1f None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.292529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 89/182] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:34.293896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337074b-cc4d-49d4-a0ef-1622c40ecf1f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.326737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.369191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834af04a-7cca-43b8-b455-8a4c8540398a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:34.391904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.413505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:34.414634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.414979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.415732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.419055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337074b-cc4d-49d4-a0ef-1622c40ecf1f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:34.463236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbfb73-d51c-4071-a31c-62a15d11dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:34.463868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbfb73-d51c-4071-a31c-62a15d11dbcb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.464144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbfb73-d51c-4071-a31c-62a15d11dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.464483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbfb73-d51c-4071-a31c-62a15d11dbcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.476129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbfb73-d51c-4071-a31c-62a15d11dbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-3ffbfb73-d51c-4071-a31c-62a15d11dbcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:34.482278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:34.483213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 90/183] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:34.484054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd83afe-4282-4a29-aaed-dd11c6b8e3d8 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.484861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd83afe-4282-4a29-aaed-dd11c6b8e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.484861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd83afe-4282-4a29-aaed-dd11c6b8e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.498808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:34.500674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:34.504288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-dbd83afe-4282-4a29-aaed-dd11c6b8e3d8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:34.505505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-dbd83afe-4282-4a29-aaed-dd11c6b8e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:34.582748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 91/184] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:34.584008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8601a1-029d-4c37-8a98-6a5f1ad15216 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.584292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8601a1-029d-4c37-8a98-6a5f1ad15216 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.584592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8601a1-029d-4c37-8a98-6a5f1ad15216 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.588425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 92/185] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:34.588425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8601a1-029d-4c37-8a98-6a5f1ad15216 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.599475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.625444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 94/186] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:34.630760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.667548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.705098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8601a1-029d-4c37-8a98-6a5f1ad15216 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:34.733352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251af76-3ae1-4b8a-afce-07a91b11e3e8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:34.741753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4e775-ae43-403c-8093-b01a9460c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:34.742442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4e775-ae43-403c-8093-b01a9460c4d9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.742719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4e775-ae43-403c-8093-b01a9460c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.742998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4e775-ae43-403c-8093-b01a9460c4d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.754149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4e775-ae43-403c-8093-b01a9460c4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-c0b4e775-ae43-403c-8093-b01a9460c4d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:34.759538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:34.760638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:34.761652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 93/187] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:34.762500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9352c-a178-4baf-819c-8d6a9d0947b5 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.762500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9352c-a178-4baf-819c-8d6a9d0947b5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.762500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9352c-a178-4baf-819c-8d6a9d0947b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.776412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:34.776412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.776412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.776412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.776933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:34.777119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:34.778553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:34.780129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b1c9352c-a178-4baf-819c-8d6a9d0947b5 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:34.781344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b1c9352c-a178-4baf-819c-8d6a9d0947b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:34.787681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 95/188] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:34.792602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.831007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.858619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 94/189] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:34.859688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9352c-a178-4baf-819c-8d6a9d0947b5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.898199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92678b03-7cd0-4a04-a026-2e1390fd5b10 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:34.926487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:34.936153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:34.937027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:34.937476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:34.937937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] PATH_INFO: `/v3/projects/947e079a1263461da06848e68a78f718` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:34.939251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=947e079a1263461da06848e68a78f718)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:34.940897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:34.942754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 96/190] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/projects/947e079a1263461da06848e68a78f718 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:34.943785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:34.979398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9352c-a178-4baf-819c-8d6a9d0947b5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.014096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.014630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.014910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.015175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.015829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:35.016125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.017529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.026368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 95/191] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:35.027145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.047754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970352c6-ec84-46d7-9c2c-33adcb5cf2b8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.055049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.083617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.084243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.084561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.084832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] PATH_INFO: `/v3/users/cafd143f6ed64da8a10d0ba5a70256ae` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.098369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] RBAC: Authorizing `identity:get_user(user_id=cafd143f6ed64da8a10d0ba5a70256ae)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.099828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.106957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 97/192] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:34 2022] GET /identity/v3/users/cafd143f6ed64da8a10d0ba5a70256ae => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:35.106957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.139690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eab95-eeac-48e7-a3dd-aeed94613d1b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.157450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.174786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.175401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.175678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.175944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.186143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:35.190897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:35.191817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:35.192644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 96/193] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:35.193337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.206730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5565195-1c17-4ea5-9639-4963809b5de7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.239784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.240408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.240691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.240958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.241682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, scope.project.id=947e079a1263461da06848e68a78f718, user.id=cf36f62c4afc473fb33769cbc076b8a5) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:35.242496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.243945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.249580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 98/194] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/role_assignments?user.id=cf36f62c4afc473fb33769cbc076b8a5&scope.project.id=947e079a1263461da06848e68a78f718&role.id=42931b58092d490eb3e62614a2778775 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:35.250352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.298459 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59b01-5aa4-43b1-ad92-ece09e6c76a3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.303940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.341706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.342547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.342832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.343107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] PATH_INFO: `/v3/users/d02ee47742564ff4baa82065ad04fbea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.344306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] RBAC: Authorizing `identity:get_user(user_id=d02ee47742564ff4baa82065ad04fbea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.345821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.347456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 97/195] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/users/d02ee47742564ff4baa82065ad04fbea => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:35.350062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.388982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b99e4c-4aef-446e-829c-399f96f53713 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.406588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.430929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.431551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.431829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.432103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.472987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ad86-a0d2-4f5b-bfea-f7b64d4ab34e None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.502555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.504035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.507175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.508344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.508651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.508924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.510050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.511493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.513316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 98/196] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:35.518528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.532533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.602769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 99/197] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:35.604256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.619386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7900a1-37d4-475a-a0a1-59707f457214 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.633547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.653784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.654376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.654648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.654913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.655589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:35.655889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.657282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.665041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 99/198] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:35.665790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.706679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59904-3c1d-42c0-af5a-1b93e18c6538 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.732560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.744297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.744927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.745204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.745476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.761439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd3e97-0f99-46c9-92ab-4a466be3978f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.793461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.794046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.794320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.794588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.795226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.796696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.811824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.813486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.817501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 100/199] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:16:35 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:35.829752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.864150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.927701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 100/200] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:35.928629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:35.945956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43a51b-cd6e-4280-8660-76f9c8775bff None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:35.964082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:35.987326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:35.988247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:35.988772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:35.989199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:35.990516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:35.992560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:35.994227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 101/201] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:35.994990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:36.060059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201cf6-1582-49a5-ad54-7dc0c7ad82ec None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:36.107762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:36.109177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:36.109177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:36.109571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] PATH_INFO: `/v3/users/cafd143f6ed64da8a10d0ba5a70256ae` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:36.111043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] RBAC: Authorizing `identity:get_user(user_id=cafd143f6ed64da8a10d0ba5a70256ae)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:36.112782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:36.115272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 101/202] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/users/cafd143f6ed64da8a10d0ba5a70256ae => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:36.116296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:36.123466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:36.127257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106b28-cb5e-47c1-9c7c-22a7542b4b37 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:36.167432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:36.168069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:36.168343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:36.168640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:36.169764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:36.171210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:36.173078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 102/203] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:35 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:36.173636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:36.246836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:36.254743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9ab4-627d-4a4e-b1fe-d1cea85b20ae None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:36.282693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999d9c3-b728-408e-bd1f-ead047102fe3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:36.300706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:36.301839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:36.302172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:36.302452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:36.303191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=cafd143f6ed64da8a10d0ba5a70256ae) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:36.303497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:36.305728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:36.313933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 102/204] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:36 2022] GET /identity/v3/role_assignments?user.id=cafd143f6ed64da8a10d0ba5a70256ae&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:36.315304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:36.319125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:36.319821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:36.324409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:36.324409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:36.362475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:36.421189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:36.422782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:36.449532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5393881-a606-4765-af0d-df8c105f03d0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:36.489876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:36.490670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:36.490950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:36.491223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:36.492527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] RBAC: Adding query filter params (role.id=83f47e3fe65f49a0b3edb0d175242e96, scope.project.id=06ab6cdbc24841e085a006b817751fea, user.id=d02ee47742564ff4baa82065ad04fbea) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:36.492837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:36.494879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:36.503615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 103/205] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:36 2022] GET /identity/v3/role_assignments?user.id=d02ee47742564ff4baa82065ad04fbea&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=83f47e3fe65f49a0b3edb0d175242e96 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:36.620576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 103/206] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:36.626567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:36.654960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:36.735980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713faaa-de5a-4940-a8fc-27b88bc6d911 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:36.772533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f427d8-e3e9-492e-b406-32ebf7febc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:36.773781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f427d8-e3e9-492e-b406-32ebf7febc4b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:36.773976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f427d8-e3e9-492e-b406-32ebf7febc4b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:36.774262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f427d8-e3e9-492e-b406-32ebf7febc4b None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:36.775391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f427d8-e3e9-492e-b406-32ebf7febc4b None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:36.776883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f427d8-e3e9-492e-b406-32ebf7febc4b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:36.778731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 104/207] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:36 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:36.784317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:36.852018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:36.892374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed399-fd5c-4cbe-9917-b8c966308f21 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:36.927118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00615bc-4ce0-47dd-a0d3-7287cb61c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:36.927721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00615bc-4ce0-47dd-a0d3-7287cb61c7dc None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:36.927996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00615bc-4ce0-47dd-a0d3-7287cb61c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:36.928327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00615bc-4ce0-47dd-a0d3-7287cb61c7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:36.929090 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00615bc-4ce0-47dd-a0d3-7287cb61c7dc None admin] RBAC: Adding query filter params (role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=cafd143f6ed64da8a10d0ba5a70256ae) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:36.929449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00615bc-4ce0-47dd-a0d3-7287cb61c7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:36.931384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00615bc-4ce0-47dd-a0d3-7287cb61c7dc None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:36.937372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 104/208] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:36 2022] GET /identity/v3/role_assignments?user.id=cafd143f6ed64da8a10d0ba5a70256ae&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:37.897322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ad470-7a06-488f-b0b1-c2d72999844b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:37.897982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ad470-7a06-488f-b0b1-c2d72999844b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:37.897982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ad470-7a06-488f-b0b1-c2d72999844b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:37.899184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 105/209] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:37.904408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c070-a34d-4ab7-a7f7-2431de6824f1 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:37.904852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c070-a34d-4ab7-a7f7-2431de6824f1 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:37.905132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c070-a34d-4ab7-a7f7-2431de6824f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:37.924263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7c53c070-a34d-4ab7-a7f7-2431de6824f1 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:37.925482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7c53c070-a34d-4ab7-a7f7-2431de6824f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:37.999759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 105/210] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:38.169065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908dc0d-026f-4668-87e4-bade2c51320b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.169674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908dc0d-026f-4668-87e4-bade2c51320b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.170159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908dc0d-026f-4668-87e4-bade2c51320b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.171693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 106/211] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:38.176869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c1426-96f8-4ecd-a64c-e62a0d0c1983 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.177414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c1426-96f8-4ecd-a64c-e62a0d0c1983 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.177883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c1426-96f8-4ecd-a64c-e62a0d0c1983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.196880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b31c1426-96f8-4ecd-a64c-e62a0d0c1983 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:38.198334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b31c1426-96f8-4ecd-a64c-e62a0d0c1983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:38.257661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:38.268331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 106/212] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:38.274429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908dc0d-026f-4668-87e4-bade2c51320b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:38.373490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:38.384449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908dc0d-026f-4668-87e4-bade2c51320b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:38.419158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17bf41-7756-49ea-8a76-049a8e1deca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:38.419715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17bf41-7756-49ea-8a76-049a8e1deca5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.419993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17bf41-7756-49ea-8a76-049a8e1deca5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.420262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17bf41-7756-49ea-8a76-049a8e1deca5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.431353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17bf41-7756-49ea-8a76-049a8e1deca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-9b17bf41-7756-49ea-8a76-049a8e1deca5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:38.436304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:38.437206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:38.438003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 107/213] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:38.446170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c1426-96f8-4ecd-a64c-e62a0d0c1983 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:38.490990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501eb0d-c927-43a4-bd41-79623fa47b04 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.491270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501eb0d-c927-43a4-bd41-79623fa47b04 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.491801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501eb0d-c927-43a4-bd41-79623fa47b04 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.493222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 108/214] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:38.498409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0c8f-1770-4bb6-8a54-14cd44eea2f9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.498853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0c8f-1770-4bb6-8a54-14cd44eea2f9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.499273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0c8f-1770-4bb6-8a54-14cd44eea2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.526696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-415a0c8f-1770-4bb6-8a54-14cd44eea2f9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:38.528112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-415a0c8f-1770-4bb6-8a54-14cd44eea2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:38.559876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c1426-96f8-4ecd-a64c-e62a0d0c1983 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:38.599745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:38.600822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.601834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.602334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.603811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:38.604366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:38.606444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:38.607699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 109/215] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:38.608410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a0c8f-1770-4bb6-8a54-14cd44eea2f9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:38.627846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 107/216] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:38.632715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:38.701091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:38.702468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:38.721310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a0c8f-1770-4bb6-8a54-14cd44eea2f9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:38.754212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d4dfc-0bad-4f1c-8eea-8c1ab48e5126 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:38.758825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:38.759718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.760228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.760741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.762050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:38.763714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:38.765515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 110/217] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:38.770831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:38.791673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:38.792302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.792605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.792870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] PATH_INFO: `/v3/users/31b8caacaf9a440a9be9afd399d26fc8` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.808616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] RBAC: Authorizing `identity:get_user(user_id=31b8caacaf9a440a9be9afd399d26fc8)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:38.809821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:38.811453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 108/218] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:38 2022] GET /identity/v3/users/31b8caacaf9a440a9be9afd399d26fc8 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:38.817025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:38.875987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698290-7e65-46eb-8ea9-d8c20da7af89 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:38.912303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:38.913005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.913311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.913580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:38.914793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:38.916231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:38.922718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8548e31-de26-45a0-93dc-addba9b2eb21 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:38.936933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 111/219] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:16:38 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:38.937791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:38.949296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:38.957701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:38.964066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7869c8d-f939-4170-8251-47aa4c5612ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:38.965039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869c8d-f939-4170-8251-47aa4c5612ae None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:38.965475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869c8d-f939-4170-8251-47aa4c5612ae None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:38.965748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869c8d-f939-4170-8251-47aa4c5612ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.042472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7869c8d-f939-4170-8251-47aa4c5612ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:39.043973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7869c8d-f939-4170-8251-47aa4c5612ae None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:39.057670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ffee-6605-49da-808d-186b4e5f33dc None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:39.102810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990adcb9-f39c-45d5-a562-3a4603c4e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:39.103932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990adcb9-f39c-45d5-a562-3a4603c4e27d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.104043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990adcb9-f39c-45d5-a562-3a4603c4e27d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.104233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990adcb9-f39c-45d5-a562-3a4603c4e27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.114637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990adcb9-f39c-45d5-a562-3a4603c4e27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-990adcb9-f39c-45d5-a562-3a4603c4e27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:39.120144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:39.121093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:39.121900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 112/220] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:39.122551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bacf99-ce5e-413a-b321-2743c947f169 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.122730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bacf99-ce5e-413a-b321-2743c947f169 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.123725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bacf99-ce5e-413a-b321-2743c947f169 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.124175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 113/221] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:39.127813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bacf99-ce5e-413a-b321-2743c947f169 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.166185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 109/222] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:39.166902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221ab7-6442-416d-8b6b-cb660d68194d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.167713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221ab7-6442-416d-8b6b-cb660d68194d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.167713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221ab7-6442-416d-8b6b-cb660d68194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.191002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4d221ab7-6442-416d-8b6b-cb660d68194d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:39.192194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4d221ab7-6442-416d-8b6b-cb660d68194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:39.200216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:39.216347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:39.270492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bacf99-ce5e-413a-b321-2743c947f169 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:39.283670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 110/223] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:39.283670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d221ab7-6442-416d-8b6b-cb660d68194d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.334126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:39.334736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.335009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.335274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.335995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:39.336292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:39.337701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:39.357321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 114/224] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:39.361751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.448642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d221ab7-6442-416d-8b6b-cb660d68194d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:39.487972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:39.488963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.489693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.490179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.492459 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:39.494111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:39.496282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 111/225] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:39 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:39.502687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.516923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:39.581416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22895db2-adf1-4c62-9915-b996237bb4c9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:39.611773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:39.621841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:39.622987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.623261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.623533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] PATH_INFO: `/v3/users/cafd143f6ed64da8a10d0ba5a70256ae` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.624693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] RBAC: Authorizing `identity:get_user(user_id=cafd143f6ed64da8a10d0ba5a70256ae)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:39.626644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:39.628583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 115/226] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:39 2022] GET /identity/v3/users/cafd143f6ed64da8a10d0ba5a70256ae => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:39.634223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.659926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72412b30-2f4b-4d1f-aca2-1cc7372e7fe2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:39.697752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:39.698349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.698728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.698993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.699828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=31b8caacaf9a440a9be9afd399d26fc8) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:39.700128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:39.701583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:39.707432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 112/227] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:39 2022] GET /identity/v3/role_assignments?user.id=31b8caacaf9a440a9be9afd399d26fc8&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=42931b58092d490eb3e62614a2778775 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:39.708201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.803335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5c2f-7a19-4ccd-bf6b-e5be936f9f37 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:39.854456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:39.874088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:39.874725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.874995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.875260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.877114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:39.878554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:39.880195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 116/228] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:39 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:39.887705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.904639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e8a9-1d2e-4aa2-9a83-348e1a486fcb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:39.939917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:39.941353 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:39.941836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:39.942296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:39.953753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:39.958918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:39.959862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:39.960758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:39.963109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 113/229] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:39.968563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:39.976993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:40.044318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27bb5a-1d54-42ab-9057-b5ab6a344307 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:40.084414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:40.085142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:40.085419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:40.086030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/cafd143f6ed64da8a10d0ba5a70256ae/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:40.088347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] RBAC: Authorizing `identity:create_grant(project_id=3e0261df5d904c07b66cfae0c5073d2f, user_id=cafd143f6ed64da8a10d0ba5a70256ae, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:40.089818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:40.113359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 117/230] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:39 2022] PUT /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/cafd143f6ed64da8a10d0ba5a70256ae/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:16:40.156048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bbd09-83e5-427a-8894-1489e86eea12 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:40.199787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:40.200416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:40.200696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:40.200964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:40.201752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:40.202047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:40.203530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:40.205235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:40.221543 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:40.222641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 114/231] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:40.354746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85ec93-0325-4797-89a4-11274498009e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:40.380975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:40.395963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:40.397026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:40.397503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:40.397971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] PATH_INFO: `/v3/users/cafd143f6ed64da8a10d0ba5a70256ae` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:40.399931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] RBAC: Authorizing `identity:get_user(user_id=cafd143f6ed64da8a10d0ba5a70256ae)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:40.401606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:40.403694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 118/232] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:40 2022] GET /identity/v3/users/cafd143f6ed64da8a10d0ba5a70256ae => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:40.409508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:40.529275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f635-fe18-4ee5-824c-a7603df738b8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:40.564145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b0f2b-d2ca-4ca3-be0c-9c0952030481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:40.564818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0f2b-d2ca-4ca3-be0c-9c0952030481 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:40.565187 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0f2b-d2ca-4ca3-be0c-9c0952030481 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:40.565450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0f2b-d2ca-4ca3-be0c-9c0952030481 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:40.566591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b0f2b-d2ca-4ca3-be0c-9c0952030481 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:40.568046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b0f2b-d2ca-4ca3-be0c-9c0952030481 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:40.570099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 115/233] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:40 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:40.575737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:40.708837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df1db1-ad3d-41eb-afde-ff11aee71de8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:40.744790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d99c-30d2-4a2e-b223-a4d5e8d27c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:40.745450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d99c-30d2-4a2e-b223-a4d5e8d27c20 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:40.745726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d99c-30d2-4a2e-b223-a4d5e8d27c20 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:40.745996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d99c-30d2-4a2e-b223-a4d5e8d27c20 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/cafd143f6ed64da8a10d0ba5a70256ae/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:40.748162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5d99c-30d2-4a2e-b223-a4d5e8d27c20 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e0261df5d904c07b66cfae0c5073d2f, user_id=cafd143f6ed64da8a10d0ba5a70256ae, role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:40.749648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5d99c-30d2-4a2e-b223-a4d5e8d27c20 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:40.768170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 119/234] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:40 2022] PUT /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/cafd143f6ed64da8a10d0ba5a70256ae/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:41.188907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32753354-34a8-4bf5-85a2-b92291465d10 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:41.189401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32753354-34a8-4bf5-85a2-b92291465d10 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:41.189477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32753354-34a8-4bf5-85a2-b92291465d10 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:41.190934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 116/235] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:41.196556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb001-16e2-48cc-8bb8-dcb06246185f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:41.197053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb001-16e2-48cc-8bb8-dcb06246185f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:41.197214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb001-16e2-48cc-8bb8-dcb06246185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:41.218322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-af9bb001-16e2-48cc-8bb8-dcb06246185f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:41.219491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-af9bb001-16e2-48cc-8bb8-dcb06246185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:41.277053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258072c-1ff6-48d5-a98b-a1f3dbe2a09e None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:41.277382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258072c-1ff6-48d5-a98b-a1f3dbe2a09e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:41.277587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258072c-1ff6-48d5-a98b-a1f3dbe2a09e None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:41.279055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 117/236] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:41.280430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:41.283825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9129e7b-7bf7-4042-a34c-2ecfbd7ea022 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:41.284113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9129e7b-7bf7-4042-a34c-2ecfbd7ea022 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:41.284425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9129e7b-7bf7-4042-a34c-2ecfbd7ea022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:41.306469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c9129e7b-7bf7-4042-a34c-2ecfbd7ea022 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:41.307659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c9129e7b-7bf7-4042-a34c-2ecfbd7ea022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:41.316485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 120/237] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:41.385630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:41.396535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 118/238] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:41.654450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bb001-16e2-48cc-8bb8-dcb06246185f None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:41.733371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9129e7b-7bf7-4042-a34c-2ecfbd7ea022 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:41.766116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bb001-16e2-48cc-8bb8-dcb06246185f None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:41.811742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:41.812307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:41.812619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:41.812890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:41.829464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:41.834407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:41.835298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:41.841085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 121/239] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:41.848498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9129e7b-7bf7-4042-a34c-2ecfbd7ea022 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:41.857361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:41.886203 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:41.887268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:41.887744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:41.888228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:41.893874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:41.895559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:41.897558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 119/240] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:41.909564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:41.948643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:42.000752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:42.039385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6d9b-353e-4ccc-9119-b9f74d49253a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:42.077704 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:42.078649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.079125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.079592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.080454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:42.082118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:42.085534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdc73-667d-4882-9aa3-085a8d5bf57a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:42.111002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 120/241] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:16:41 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:16:42.144991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326248-a50b-450c-8896-6675e9d55548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:42.145990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326248-a50b-450c-8896-6675e9d55548 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.146499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326248-a50b-450c-8896-6675e9d55548 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.146966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326248-a50b-450c-8896-6675e9d55548 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.147953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326248-a50b-450c-8896-6675e9d55548 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:42.149051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326248-a50b-450c-8896-6675e9d55548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:42.150648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326248-a50b-450c-8896-6675e9d55548 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:42.165733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 122/242] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:42.171895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:42.284965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e7af-d7f6-455b-a09a-d06c4c72540c None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.285491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e7af-d7f6-455b-a09a-d06c4c72540c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.285491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e7af-d7f6-455b-a09a-d06c4c72540c None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.288462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 123/243] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:42.293430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59708a5d-1fe5-42fa-936e-2231669b8d42 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.293715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59708a5d-1fe5-42fa-936e-2231669b8d42 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.293988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59708a5d-1fe5-42fa-936e-2231669b8d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.303427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fab0-bf82-429c-b56b-0fa83b743441 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:42.315450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-59708a5d-1fe5-42fa-936e-2231669b8d42 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:42.316765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-59708a5d-1fe5-42fa-936e-2231669b8d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:42.332876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:42.366790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:42.369067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.369347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.369624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] PATH_INFO: `/v3/users/7a0d1129eff8402da704e5a387afeadd` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.389890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] RBAC: Authorizing `identity:get_user(user_id=7a0d1129eff8402da704e5a387afeadd)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:42.391388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:42.393258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 121/244] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:42 2022] GET /identity/v3/users/7a0d1129eff8402da704e5a387afeadd => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:42.399264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:42.413427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 124/245] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:42.503059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdef4bb-7d25-46b8-829d-9d6fd034318d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:42.538118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:42.538886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.539168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.539435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.586810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:42.610834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:42.612371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:42.624805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111ef29-8aec-4d56-b8b8-b88e8205a30b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.625421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111ef29-8aec-4d56-b8b8-b88e8205a30b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.626787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111ef29-8aec-4d56-b8b8-b88e8205a30b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.634663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 125/246] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:42.641102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17820-2547-45fe-a0f2-fc5aca4ac1aa None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.641637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17820-2547-45fe-a0f2-fc5aca4ac1aa None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.642137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17820-2547-45fe-a0f2-fc5aca4ac1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.674751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a8b17820-2547-45fe-a0f2-fc5aca4ac1aa None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:42.676136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a8b17820-2547-45fe-a0f2-fc5aca4ac1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:42.710770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:42.717321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 122/247] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:42.722859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:42.755934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 126/248] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:42.756632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17820-2547-45fe-a0f2-fc5aca4ac1aa None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:42.810487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:42.836094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd2239-0d34-435c-ac44-d9a87dfad2b9 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:42.875138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:42.875690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.876008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.876595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.877751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:42.879217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:42.881567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 123/249] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:42 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:42.888026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:42.909109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17820-2547-45fe-a0f2-fc5aca4ac1aa None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:42.961149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:42.962678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:42.963116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:42.963515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:42.977777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:42.984003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:42.984949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:42.985753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:42.986517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 127/250] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:42.994032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.018620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a2fd-2697-45f2-8fea-9d76c1b3426c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.022598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:43.067901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.069517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.070332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.070617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.071441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] RBAC: Adding query filter params (role.id=83f47e3fe65f49a0b3edb0d175242e96, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=7a0d1129eff8402da704e5a387afeadd) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:43.071808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:43.073331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:43.082053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 124/251] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:42 2022] GET /identity/v3/role_assignments?user.id=7a0d1129eff8402da704e5a387afeadd&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=83f47e3fe65f49a0b3edb0d175242e96 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:43.082916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.107375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:43.139459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3b66-5e7c-40ab-8880-a434ef24ede8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.190264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.190982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.191260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.191526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.192197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:43.192517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:43.193910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:43.214540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 128/252] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:43.219354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.282739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f852617-4e0e-41c5-b9f0-bb3572270a18 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.356118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb962d-8f09-47bc-9652-b36c78c58864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.357563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb962d-8f09-47bc-9652-b36c78c58864 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.358075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb962d-8f09-47bc-9652-b36c78c58864 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.358455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb962d-8f09-47bc-9652-b36c78c58864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.372146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb962d-8f09-47bc-9652-b36c78c58864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-62fb962d-8f09-47bc-9652-b36c78c58864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:43.377684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:43.378587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:43.379416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:43.380031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:43.380506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 125/253] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:43.380506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8af49-4c91-4332-a9b4-127f66a685cc None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.380629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8af49-4c91-4332-a9b4-127f66a685cc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.382296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8af49-4c91-4332-a9b4-127f66a685cc None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.386599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 126/254] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:43.387660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8af49-4c91-4332-a9b4-127f66a685cc None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.398960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa246e-9a74-4e37-9175-dbe8c869d0b4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.440846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194f5f-b51e-46a7-b86f-8c1ee26edf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.441580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194f5f-b51e-46a7-b86f-8c1ee26edf23 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.441978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194f5f-b51e-46a7-b86f-8c1ee26edf23 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.442367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194f5f-b51e-46a7-b86f-8c1ee26edf23 None admin] PATH_INFO: `/v3/users/31b8caacaf9a440a9be9afd399d26fc8` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.443834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194f5f-b51e-46a7-b86f-8c1ee26edf23 None admin] RBAC: Authorizing `identity:get_user(user_id=31b8caacaf9a440a9be9afd399d26fc8)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:43.445484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194f5f-b51e-46a7-b86f-8c1ee26edf23 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:43.447411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 129/255] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:43 2022] GET /identity/v3/users/31b8caacaf9a440a9be9afd399d26fc8 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:43.453027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb6a0-8409-485e-87fd-dfcf4fa48b61 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.453382 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb6a0-8409-485e-87fd-dfcf4fa48b61 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.453732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb6a0-8409-485e-87fd-dfcf4fa48b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.473175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d44eb6a0-8409-485e-87fd-dfcf4fa48b61 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:43.473814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:43.474542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d44eb6a0-8409-485e-87fd-dfcf4fa48b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:43.530297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8af49-4c91-4332-a9b4-127f66a685cc None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.561841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 130/256] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:43.562998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb6a0-8409-485e-87fd-dfcf4fa48b61 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.577570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.578196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.578485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.578817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.579547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:43.579853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:43.585415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:43.600121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 127/257] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:43.606389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.670268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:43.695747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb6a0-8409-485e-87fd-dfcf4fa48b61 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.748855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.756421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.757127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.758141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.759574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:43.761248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:43.763411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 131/258] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:43 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:43.769754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.803413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d574fd6-544a-42d8-9619-33d6003629ef None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.869406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:43.890821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.891461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.891776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.892004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] PATH_INFO: `/v3/users/cafd143f6ed64da8a10d0ba5a70256ae` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.897779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] RBAC: Authorizing `identity:get_user(user_id=cafd143f6ed64da8a10d0ba5a70256ae)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:43.899304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:43.901586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 128/259] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:43 2022] GET /identity/v3/users/cafd143f6ed64da8a10d0ba5a70256ae => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:43.907107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:43.930726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffa871-165e-4d77-b9ed-9ab24a6e376e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:43.993449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:43.994120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:43.994394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:43.994693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/31b8caacaf9a440a9be9afd399d26fc8/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:43.996620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e0261df5d904c07b66cfae0c5073d2f, user_id=31b8caacaf9a440a9be9afd399d26fc8, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:43.999174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:44.030817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 132/260] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:43 2022] PUT /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/31b8caacaf9a440a9be9afd399d26fc8/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:16:44.031672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:44.070708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:44.075252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0c301-0a3d-4c20-8c43-92494b5e9430 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:44.114385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:44.115012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:44.115285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:44.115551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:44.190224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:44.194579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:44.196321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:44.300852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 129/261] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:44.306767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:44.334517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6007b23-21ee-4727-9b84-2631c5d0b152 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:44.406233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda09a4-22a5-43d3-afe5-11e2d148bd0b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:44.408732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:44.421086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:44.421744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:44.422025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:44.422306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:44.442222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:44.442782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:44.443056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:44.443325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:44.444527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:44.446558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:44.449306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:44.453918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 130/262] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:44 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:44.454255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:44.455128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:44.455940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:44.456598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:44.456669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 133/263] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:44.460901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:44.617928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959c3f-308e-41cd-bf6a-d787ceac8dd0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:44.666936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:44.667550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:44.667823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:44.668089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:44.668845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=cafd143f6ed64da8a10d0ba5a70256ae) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:44.669208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:44.670705 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:44.680876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 131/264] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:44 2022] GET /identity/v3/role_assignments?user.id=cafd143f6ed64da8a10d0ba5a70256ae&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:44.707086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:44.763250 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60d7b8-206e-4886-9dcc-047c4dbe6886 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:44.817699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:44.818317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:44.818597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:44.818873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:44.819547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:44.819893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:44.821365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:44.831453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 134/265] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:44.837500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:44.871231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:44.946596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797b18-e1eb-48d0-8b64-6d18eb6c01c1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:44.984078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bd929-44dd-4a59-9efd-371b564fa8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:44.985021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd929-44dd-4a59-9efd-371b564fa8a8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:44.985480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd929-44dd-4a59-9efd-371b564fa8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:44.985972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bd929-44dd-4a59-9efd-371b564fa8a8 None admin] PATH_INFO: `/v3/users/cafd143f6ed64da8a10d0ba5a70256ae` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:44.987308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bd929-44dd-4a59-9efd-371b564fa8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cafd143f6ed64da8a10d0ba5a70256ae)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:44.988987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bd929-44dd-4a59-9efd-371b564fa8a8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:44.991111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 132/266] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:44 2022] GET /identity/v3/users/cafd143f6ed64da8a10d0ba5a70256ae => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:44.996948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:45.110875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f43a-7521-4223-b2aa-ccaaebf9d363 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:45.152559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:45.153560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:45.154022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:45.154493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:45.157459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:45.243481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:45.244913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:45.322582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b45-d710-42c6-bf25-96fe79e16eb4 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:45.322901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b45-d710-42c6-bf25-96fe79e16eb4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:45.323132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b45-d710-42c6-bf25-96fe79e16eb4 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:45.324747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 133/267] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:45.329463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f65b-ea15-4b84-8570-9b160067cc02 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:45.329765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f65b-ea15-4b84-8570-9b160067cc02 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:45.330010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f65b-ea15-4b84-8570-9b160067cc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:45.358764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-fbc1f65b-ea15-4b84-8570-9b160067cc02 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:45.359952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fbc1f65b-ea15-4b84-8570-9b160067cc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:45.403209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 135/268] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:45.410011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:45.458715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:45.530814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 134/269] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:45.534566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627af09-2cd0-4f90-b3c1-9463fcff7eb2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:45.575402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123de5f-feb0-4812-8da4-854fae15e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:45.576404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123de5f-feb0-4812-8da4-854fae15e9ba None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:45.576883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123de5f-feb0-4812-8da4-854fae15e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:45.577348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123de5f-feb0-4812-8da4-854fae15e9ba None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:45.578837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123de5f-feb0-4812-8da4-854fae15e9ba None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:45.580511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123de5f-feb0-4812-8da4-854fae15e9ba None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:45.582340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 136/270] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:45 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:45.588808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1f65b-ea15-4b84-8570-9b160067cc02 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:45.652085 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:45.653490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64384b-2fac-47f5-83f0-94b9e54fc115 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:45.653989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64384b-2fac-47f5-83f0-94b9e54fc115 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:45.654346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64384b-2fac-47f5-83f0-94b9e54fc115 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:45.655764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 137/271] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:45.664072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663b2e-5bf7-41cd-a8a0-158203f5ed49 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:45.664349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663b2e-5bf7-41cd-a8a0-158203f5ed49 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:45.668938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663b2e-5bf7-41cd-a8a0-158203f5ed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:45.695911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-87663b2e-5bf7-41cd-a8a0-158203f5ed49 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:45.697457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-87663b2e-5bf7-41cd-a8a0-158203f5ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:45.781813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 138/272] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:45.790623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1f65b-ea15-4b84-8570-9b160067cc02 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:45.838087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:45.838740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:45.839022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:45.839292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:45.840019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] RBAC: Adding query filter params (role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=cafd143f6ed64da8a10d0ba5a70256ae) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:45.840325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:45.841806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:45.851643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 135/273] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:45 2022] GET /identity/v3/role_assignments?user.id=cafd143f6ed64da8a10d0ba5a70256ae&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:45.859710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663b2e-5bf7-41cd-a8a0-158203f5ed49 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:45.918287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:46.022156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663b2e-5bf7-41cd-a8a0-158203f5ed49 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:46.059855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:46.060445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.060726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.060996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.071708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:46.076656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:46.077541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:46.078757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 139/274] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:46.083844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:46.146606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:46.182398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:46.192977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b7010-21a2-463b-840d-dacb367a1bd5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:46.236309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6a75d-8a53-438a-a701-3098a451d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:46.237358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6a75d-8a53-438a-a701-3098a451d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.237836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6a75d-8a53-438a-a701-3098a451d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.238367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6a75d-8a53-438a-a701-3098a451d3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.239267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6a75d-8a53-438a-a701-3098a451d3e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:46.239769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6a75d-8a53-438a-a701-3098a451d3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:46.241398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6a75d-8a53-438a-a701-3098a451d3e5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:46.250740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 136/275] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:46.252455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e095cbd-d518-4ff8-9ef4-563f0064c4e0 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.252962 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e095cbd-d518-4ff8-9ef4-563f0064c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.253434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e095cbd-d518-4ff8-9ef4-563f0064c4e0 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.254836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 137/276] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:46.259603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e095cbd-d518-4ff8-9ef4-563f0064c4e0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:46.268946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:46.279916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de4fd-e255-4897-9603-76312d5158b1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:46.316197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f79be-039b-4650-8a20-661c01da428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:46.316787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f79be-039b-4650-8a20-661c01da428a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.317077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f79be-039b-4650-8a20-661c01da428a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.317338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f79be-039b-4650-8a20-661c01da428a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.318550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f79be-039b-4650-8a20-661c01da428a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:46.320226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f79be-039b-4650-8a20-661c01da428a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:46.321957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 140/277] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:46.323256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef7ecc-f84e-4575-be51-592cc685ffc4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.323538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef7ecc-f84e-4575-be51-592cc685ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.323811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef7ecc-f84e-4575-be51-592cc685ffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.343863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b3ef7ecc-f84e-4575-be51-592cc685ffc4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:46.345207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b3ef7ecc-f84e-4575-be51-592cc685ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:46.370512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e095cbd-d518-4ff8-9ef4-563f0064c4e0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:46.405534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:46.406168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.406446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.406715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] PATH_INFO: `/v3/users/150c117dee13463da13a156d23a984a3` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.424404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 141/278] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:46.424404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef7ecc-f84e-4575-be51-592cc685ffc4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:46.432820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] RBAC: Authorizing `identity:get_user(user_id=150c117dee13463da13a156d23a984a3)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:46.434434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:46.441741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 138/279] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:46 2022] GET /identity/v3/users/150c117dee13463da13a156d23a984a3 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:46.442601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:46.458610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:46.545336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:46.557013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef7ecc-f84e-4575-be51-592cc685ffc4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:46.579136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707f176-c755-4ed3-bbbf-3dd491add5ce None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:46.603173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883071a-f57a-472b-b7dd-22e569cdd2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:46.604310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883071a-f57a-472b-b7dd-22e569cdd2bd None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.604740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883071a-f57a-472b-b7dd-22e569cdd2bd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.605109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883071a-f57a-472b-b7dd-22e569cdd2bd None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.606094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883071a-f57a-472b-b7dd-22e569cdd2bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:46.608315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883071a-f57a-472b-b7dd-22e569cdd2bd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:46.617486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:46.618266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.618737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.619211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.620107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, user.id=150c117dee13463da13a156d23a984a3, scope.system=all) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:46.620738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:46.622687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:46.630940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 139/280] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Sep 1 00:16:46 2022] GET /identity/v3/role_assignments?user.id=150c117dee13463da13a156d23a984a3&scope.system=all&role.id=42931b58092d490eb3e62614a2778775 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:46.640883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 142/281] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:16:46 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:46.719517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:46.800647 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07193bb-af2d-4fc1-abf8-ce0a6f922bb2 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.800932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07193bb-af2d-4fc1-abf8-ce0a6f922bb2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.801203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07193bb-af2d-4fc1-abf8-ce0a6f922bb2 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.802682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 143/282] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:46.807838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fac0e-459e-4c61-839e-68476db6e050 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.808123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fac0e-459e-4c61-839e-68476db6e050 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.808415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fac0e-459e-4c61-839e-68476db6e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.822495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:46.829354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-724fac0e-459e-4c61-839e-68476db6e050 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:46.830832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-724fac0e-459e-4c61-839e-68476db6e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:46.846445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f77c-9ad7-4771-94fd-a45c64173d14 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:46.893922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:46.894557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:46.894829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:46.895095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:46.908929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:46.913103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 144/283] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:46.916425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:46.917327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:46.918145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 140/284] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:46.921496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fac0e-459e-4c61-839e-68476db6e050 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:47.012153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:47.037094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fac0e-459e-4c61-839e-68476db6e050 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:47.074142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:47.075093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:47.075422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:47.075696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:47.076369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:47.076700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:47.078114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:47.088985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 145/285] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:47.094743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:47.195203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:47.212079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847fe08-eaaf-49fb-b07f-79d51cd03abe None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:47.253269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:47.254265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:47.254767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:47.255226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] PATH_INFO: `/v3/users/7a0d1129eff8402da704e5a387afeadd` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:47.256579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] RBAC: Authorizing `identity:get_user(user_id=7a0d1129eff8402da704e5a387afeadd)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:47.259138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:47.261420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 141/286] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:47 2022] GET /identity/v3/users/7a0d1129eff8402da704e5a387afeadd => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:47.266763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:47.273193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:47.427491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5e840-7fa8-49e9-89f3-c10ba4025ea7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:47.442325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5108e0-a0af-4edc-ba84-bf6cf3dce384 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:47.465492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:47.466485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:47.466957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:47.467417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:47.479630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:47.487030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:47.487935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:47.488752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:47.490608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 146/287] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:47.490608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:47.497277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:47.576006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:47.576683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:47.576967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:47.577235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:47.578409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:47.579873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:47.581561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 142/288] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:47 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:47.589302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:47.608899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57a08-3f3c-44fb-af73-dff1fd97dedb None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:47.645046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:47.645653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:47.645925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:47.646196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:47.646852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] RBAC: Adding query filter params (name=member) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:47.647206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:47.648823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:47.658302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 147/289] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:47.663360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:47.702258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:47.756639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296bf5-a8bf-4a72-85c9-f5f00f016bad None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:47.781282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:47.806126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:47.807549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:47.808032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:47.808554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/7a0d1129eff8402da704e5a387afeadd/roles/83f47e3fe65f49a0b3edb0d175242e96` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:47.810728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e0261df5d904c07b66cfae0c5073d2f, user_id=7a0d1129eff8402da704e5a387afeadd, role_id=83f47e3fe65f49a0b3edb0d175242e96)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:47.812792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:47.836509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 143/290] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:16:47 2022] PUT /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/users/7a0d1129eff8402da704e5a387afeadd/roles/83f47e3fe65f49a0b3edb0d175242e96 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:47.847415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83440c79-ff67-43c4-9a95-8cc329fc876e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:47.888679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:47.889426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:47.889705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:47.890022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] PATH_INFO: `/v3/users/31b8caacaf9a440a9be9afd399d26fc8` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:47.891289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] RBAC: Authorizing `identity:get_user(user_id=31b8caacaf9a440a9be9afd399d26fc8)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:47.892760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:47.894701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 148/291] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:47 2022] GET /identity/v3/users/31b8caacaf9a440a9be9afd399d26fc8 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:47.900583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:48.046189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d10c-30a5-4d7d-9213-ba50c4612db8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:48.081084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:48.089036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:48.089825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:48.090169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:48.090561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:48.179858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:48.181483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:48.314826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 144/292] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:48.321021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:48.426093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560576f-a9c4-4ff0-93e2-10516156a2f4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:48.453722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:48.463511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711f2ef-2212-4913-ae8a-97b134d9e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:48.464152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711f2ef-2212-4913-ae8a-97b134d9e96c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:48.464453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711f2ef-2212-4913-ae8a-97b134d9e96c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:48.464727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711f2ef-2212-4913-ae8a-97b134d9e96c None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:48.465841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711f2ef-2212-4913-ae8a-97b134d9e96c None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:48.467343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711f2ef-2212-4913-ae8a-97b134d9e96c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:48.468988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 149/293] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:48 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:48.475476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:48.541843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:48.637984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a6e1a-94ab-4aae-8320-6e67a10e1c13 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:48.685728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1055-85f2-4d40-be7e-2fc4734083e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:48.686528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1055-85f2-4d40-be7e-2fc4734083e4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:48.686813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1055-85f2-4d40-be7e-2fc4734083e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:48.687075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1055-85f2-4d40-be7e-2fc4734083e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:48.687855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1055-85f2-4d40-be7e-2fc4734083e4 None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=31b8caacaf9a440a9be9afd399d26fc8) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:48.688166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1055-85f2-4d40-be7e-2fc4734083e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:48.689642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1055-85f2-4d40-be7e-2fc4734083e4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:48.699124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 145/294] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:48 2022] GET /identity/v3/role_assignments?user.id=31b8caacaf9a440a9be9afd399d26fc8&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=42931b58092d490eb3e62614a2778775 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:49.060521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb04f3-6587-453b-99bd-addf4183da11 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.061028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb04f3-6587-453b-99bd-addf4183da11 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.061104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb04f3-6587-453b-99bd-addf4183da11 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.062449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 150/295] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:49.067707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c28fd-f67c-4392-9567-163a776bc79a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.068027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c28fd-f67c-4392-9567-163a776bc79a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.068307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c28fd-f67c-4392-9567-163a776bc79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.090373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a08c28fd-f67c-4392-9567-163a776bc79a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:49.091625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a08c28fd-f67c-4392-9567-163a776bc79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:49.183006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 146/296] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:49.208135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f3ab-3e5e-4951-bab8-df7ff4442bc5 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.208796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f3ab-3e5e-4951-bab8-df7ff4442bc5 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.209270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f3ab-3e5e-4951-bab8-df7ff4442bc5 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.211330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 151/297] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:49.216652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aeb5f-e5a3-4083-931d-fa86f4c74ae5 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.216899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55aed4-e7fb-4639-b424-e9a56076b46d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.217123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55aed4-e7fb-4639-b424-e9a56076b46d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.217393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55aed4-e7fb-4639-b424-e9a56076b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.217781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aeb5f-e5a3-4083-931d-fa86f4c74ae5 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.218259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aeb5f-e5a3-4083-931d-fa86f4c74ae5 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.220156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 152/298] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:49.225278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a50b2f-d6ce-4666-a1c9-2423d34addaa None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.225812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a50b2f-d6ce-4666-a1c9-2423d34addaa None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.225812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a50b2f-d6ce-4666-a1c9-2423d34addaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.240701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1a55aed4-e7fb-4639-b424-e9a56076b46d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:49.242729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1a55aed4-e7fb-4639-b424-e9a56076b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:49.245719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-87a50b2f-d6ce-4666-a1c9-2423d34addaa None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:49.246948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-87a50b2f-d6ce-4666-a1c9-2423d34addaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:49.271520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:49.329259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 153/299] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:49.336931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 147/300] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:49.478170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a50b2f-d6ce-4666-a1c9-2423d34addaa None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:49.586244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a50b2f-d6ce-4666-a1c9-2423d34addaa None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:49.613330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:49.621867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55aed4-e7fb-4639-b424-e9a56076b46d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:49.623839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:49.624668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.625064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.625224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.637895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:49.642752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:49.643638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 154/301] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:49.645279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:49.729781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55aed4-e7fb-4639-b424-e9a56076b46d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:49.750194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9251b7-7fc3-4ba6-9445-2e37de84b24f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:49.765810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:49.766434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.766707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.766973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.777930 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:49.783080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:49.783992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 148/302] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:49.785278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:49.790770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:49.791415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.791693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.791959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.793085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:49.794536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:49.796103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 155/303] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:49.796885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:49.810943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:49.858847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:49.905000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec1d47-d05a-4067-b036-a967dd4255fd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:49.912824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f16eb8-fbd8-4702-8b61-8a45ee58034c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:49.940073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:49.940724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.940996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.941268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.941925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:49.942225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:49.943595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:49.949173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:49.949779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:49.950062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:49.950332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:49.950990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:49.951288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:49.952158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 149/304] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:49.952783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:49.957123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:49.966407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 156/305] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:49.967204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:50.036762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:50.060312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17632-a7e5-494d-8773-56c4a29b7d5c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:50.083404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200001-6c50-4388-95fd-8a310046ae72 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:50.097009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:50.097617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.097897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.098174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] PATH_INFO: `/v3/groups` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.098794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:50.100230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:50.102213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:50.117742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 150/306] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Sep 1 00:16:49 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:16:50.118489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:50.130013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:50.130783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.131131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.131466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] PATH_INFO: `/v3/users/150c117dee13463da13a156d23a984a3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.133009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] RBAC: Authorizing `identity:get_user(user_id=150c117dee13463da13a156d23a984a3)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:50.134659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:50.136806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 157/307] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:49 2022] GET /identity/v3/users/150c117dee13463da13a156d23a984a3 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:50.145915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:50.262403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43826a6-b779-4e8d-a10c-23bc63c20a96 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:50.264837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc09ab-80ee-4b6f-b920-2499cc9440cf None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:50.304115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:50.304837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.305635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.305718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082395b-4772-4b52-b194-bec09b3e7d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:50.305819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] PATH_INFO: `/v3/users/e7f08491590244569509d7a5c9a59fd0` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.305893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082395b-4772-4b52-b194-bec09b3e7d68 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.306050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082395b-4772-4b52-b194-bec09b3e7d68 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.306296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082395b-4772-4b52-b194-bec09b3e7d68 None admin] PATH_INFO: `/v3/system/users/150c117dee13463da13a156d23a984a3/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.307782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082395b-4772-4b52-b194-bec09b3e7d68 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=150c117dee13463da13a156d23a984a3, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:50.309840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082395b-4772-4b52-b194-bec09b3e7d68 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:50.314890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:50.318927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 158/308] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Sep 1 00:16:50 2022] PUT /identity/v3/system/users/150c117dee13463da13a156d23a984a3/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:50.323693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69767e2a-158f-47de-9654-96d28db4c2fb None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.323693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69767e2a-158f-47de-9654-96d28db4c2fb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.323693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69767e2a-158f-47de-9654-96d28db4c2fb None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.324132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 159/309] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:50.328788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] RBAC: Authorizing `identity:get_user(user_id=e7f08491590244569509d7a5c9a59fd0)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:50.330477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:50.332575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 151/310] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:50 2022] GET /identity/v3/users/e7f08491590244569509d7a5c9a59fd0 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:50.334304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9b31-d581-4954-af53-4963dee20aec None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.334591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9b31-d581-4954-af53-4963dee20aec None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.334862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9b31-d581-4954-af53-4963dee20aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.344418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:50.370213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-11cc9b31-d581-4954-af53-4963dee20aec None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:50.371908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-11cc9b31-d581-4954-af53-4963dee20aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:50.433305 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:50.462315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 160/311] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:50.465052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e05e-b9b7-4b0f-a4e2-0531654134e5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:50.501098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:50.501712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.501996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.502273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.503012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] RBAC: Adding query filter params (role.id=83f47e3fe65f49a0b3edb0d175242e96, user.id=e7f08491590244569509d7a5c9a59fd0, scope.system=all) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:50.503324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:50.504814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:50.510916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 152/312] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Sep 1 00:16:50 2022] GET /identity/v3/role_assignments?user.id=e7f08491590244569509d7a5c9a59fd0&scope.system=all&role.id=83f47e3fe65f49a0b3edb0d175242e96 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:50.753572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9b31-d581-4954-af53-4963dee20aec None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:50.860489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9b31-d581-4954-af53-4963dee20aec None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:50.895718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:50.896345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:50.896652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:50.896926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:50.907911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:50.912839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:50.913862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:50.914684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:50.918810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 161/313] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:50.920148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:50.985134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:51.029010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e31da-333e-4f40-98a0-a81fa7ecee9a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:51.064873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:51.065481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:51.065817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:51.066034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:51.066760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:51.067061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:51.068548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:51.078461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 153/314] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:51.083754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:51.136734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:51.202402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eeac4-7bd0-4f24-b0a9-32df0f897ffe None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:51.238790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:51.239728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:51.240146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:51.240682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] PATH_INFO: `/v3/users/7a0d1129eff8402da704e5a387afeadd` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:51.242765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=7a0d1129eff8402da704e5a387afeadd)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:51.244473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:51.246313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 162/315] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:51 2022] GET /identity/v3/users/7a0d1129eff8402da704e5a387afeadd => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:51.256408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:51.360648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3793e-e411-4647-8675-55d2c3618ba5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:51.385432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:51.398580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:51.399192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:51.399471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:51.399743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:51.473300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:51.474774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:51.588939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 154/316] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:51.597547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:51.704726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6151e8-9132-40af-a59b-c312660d9dc5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:51.712808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:51.746500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abe362-77cf-4d5f-a4a2-484d330d85f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:51.747134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abe362-77cf-4d5f-a4a2-484d330d85f3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:51.747408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abe362-77cf-4d5f-a4a2-484d330d85f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:51.747676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abe362-77cf-4d5f-a4a2-484d330d85f3 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:51.748830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abe362-77cf-4d5f-a4a2-484d330d85f3 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:51.750290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abe362-77cf-4d5f-a4a2-484d330d85f3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:51.751907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 163/317] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:51 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:51.757792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:51.783235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:51.863698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b12d1-1ce5-4920-b5c4-3a5d4202b635 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:51.903495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62de06-5501-42cc-b619-2b03c4fc35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:51.904494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62de06-5501-42cc-b619-2b03c4fc35ad None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:51.904976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62de06-5501-42cc-b619-2b03c4fc35ad None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:51.905462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62de06-5501-42cc-b619-2b03c4fc35ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:51.906402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62de06-5501-42cc-b619-2b03c4fc35ad None admin] RBAC: Adding query filter params (role.id=83f47e3fe65f49a0b3edb0d175242e96, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f, user.id=7a0d1129eff8402da704e5a387afeadd) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:51.906920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62de06-5501-42cc-b619-2b03c4fc35ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:51.908606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62de06-5501-42cc-b619-2b03c4fc35ad None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:51.915896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 155/318] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:16:51 2022] GET /identity/v3/role_assignments?user.id=7a0d1129eff8402da704e5a387afeadd&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=83f47e3fe65f49a0b3edb0d175242e96 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:52.107155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f90482-41c0-45c2-842a-b4f5395af48a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.107628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f90482-41c0-45c2-842a-b4f5395af48a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.107628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f90482-41c0-45c2-842a-b4f5395af48a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.109287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 164/319] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:52.114232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2425b7-7ac8-4d9b-8313-41dc12e2ff17 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.114665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2425b7-7ac8-4d9b-8313-41dc12e2ff17 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.114966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2425b7-7ac8-4d9b-8313-41dc12e2ff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.136066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7a2425b7-7ac8-4d9b-8313-41dc12e2ff17 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:52.139273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7a2425b7-7ac8-4d9b-8313-41dc12e2ff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:52.208629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 156/320] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:52.403077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7a98-bd33-48b1-bbc3-3beffeb5685d None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.403264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7a98-bd33-48b1-bbc3-3beffeb5685d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.403572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7a98-bd33-48b1-bbc3-3beffeb5685d None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.404980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 165/321] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:52.410268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79846-b05e-48cf-af4f-190733c5f5ee None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.410554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79846-b05e-48cf-af4f-190733c5f5ee None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.410825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79846-b05e-48cf-af4f-190733c5f5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.428649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-15d79846-b05e-48cf-af4f-190733c5f5ee None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:52.430355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-15d79846-b05e-48cf-af4f-190733c5f5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:52.441512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:52.474690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7a98-bd33-48b1-bbc3-3beffeb5685d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:52.503376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 157/322] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:52.561743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac3c4-049f-4a9a-a074-212bbe8dc715 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.562077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac3c4-049f-4a9a-a074-212bbe8dc715 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.562299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac3c4-049f-4a9a-a074-212bbe8dc715 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.563872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 158/323] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:16:52.569405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938422fd-2039-4212-ab6d-1151fff89bb6 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.570576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938422fd-2039-4212-ab6d-1151fff89bb6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.570858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938422fd-2039-4212-ab6d-1151fff89bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.589627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-938422fd-2039-4212-ab6d-1151fff89bb6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:52.589901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7a98-bd33-48b1-bbc3-3beffeb5685d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:52.590812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-938422fd-2039-4212-ab6d-1151fff89bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:52.626286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:52.626921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.627199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.627467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.628746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:52.630361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:52.632084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 166/324] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:16:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:52.637421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:52.663035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 159/325] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:52.681965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:52.739965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cb46a-b8f6-4ea5-a027-be71bbfefb8d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:52.774533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:52.775141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.775421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.775691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] PATH_INFO: `/v3/groups` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.776444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:52.777320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938422fd-2039-4212-ab6d-1151fff89bb6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:52.777894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:52.795746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 167/326] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Sep 1 00:16:52 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:16:52.864067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:52.890830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938422fd-2039-4212-ab6d-1151fff89bb6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:52.927368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:52.928596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:52.928878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:52.929215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:52.941943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:52.945742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:52.947519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:52.948443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:52.949262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 160/327] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:16:52.954162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:53.079305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67a2fc-00aa-46e7-9450-99c6cc5eb271 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:53.079648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f2ca3-9ac6-4dd2-ac18-6659d486b3ff None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:53.081381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:53.122116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:53.122650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:53.123014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:53.123014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:53.123176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:53.123247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:53.123314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:53.123618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:53.123924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:53.124224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:53.125642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:53.128709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:53.136747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 161/328] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:53.138412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:53.142060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:53.144344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:53.145371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:53.146182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:53.148905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 168/329] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:16:53.153751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:53.275373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77595b-edda-4e8f-8d23-c8f9051394c0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:53.298527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd326de-565f-431e-8a20-0a842a0b3650 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:53.313373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:53.314012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:53.314291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:53.314664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] PATH_INFO: `/v3/users/150c117dee13463da13a156d23a984a3` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:53.315916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] RBAC: Authorizing `identity:get_user(user_id=150c117dee13463da13a156d23a984a3)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:53.317479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:53.320182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 162/330] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:53 2022] GET /identity/v3/users/150c117dee13463da13a156d23a984a3 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:53.328741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:53.340338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:53.340338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:53.340618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:53.348574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:53.348574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:53.348574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:53.348574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:53.362256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 169/331] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:53.367655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:53.410431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:53.416343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:53.463037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419063f-5b71-4f3e-a8ef-0418529c7531 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:53.486434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1ed5e-0475-4a5d-9c9b-d2eda2d70251 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:53.515690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:53.516306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:53.516608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:53.520406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:53.520406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] RBAC: Adding query filter params (role.id=42931b58092d490eb3e62614a2778775, user.id=150c117dee13463da13a156d23a984a3, scope.system=all) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:53.520406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:53.520406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:53.534873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 163/332] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Sep 1 00:16:53 2022] GET /identity/v3/role_assignments?user.id=150c117dee13463da13a156d23a984a3&scope.system=all&role.id=42931b58092d490eb3e62614a2778775 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:53.550299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73b92a-50ae-4e71-920f-6438c872110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:53.550960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b92a-50ae-4e71-920f-6438c872110c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:53.551242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b92a-50ae-4e71-920f-6438c872110c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:53.551517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b92a-50ae-4e71-920f-6438c872110c None admin] PATH_INFO: `/v3/users/e7f08491590244569509d7a5c9a59fd0` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:53.552712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73b92a-50ae-4e71-920f-6438c872110c None admin] RBAC: Authorizing `identity:get_user(user_id=e7f08491590244569509d7a5c9a59fd0)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:53.554748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73b92a-50ae-4e71-920f-6438c872110c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:53.556807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 170/333] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:53 2022] GET /identity/v3/users/e7f08491590244569509d7a5c9a59fd0 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:53.562520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:53.678713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fa3c5-c35a-4009-b01c-0ed971623796 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:53.706969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:53.720679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05d471-8bc3-4228-873e-4bf50337d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:53.721346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d471-8bc3-4228-873e-4bf50337d4ad None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:53.721624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d471-8bc3-4228-873e-4bf50337d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:53.721898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d471-8bc3-4228-873e-4bf50337d4ad None admin] PATH_INFO: `/v3/system/users/e7f08491590244569509d7a5c9a59fd0/roles/83f47e3fe65f49a0b3edb0d175242e96` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:53.723374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05d471-8bc3-4228-873e-4bf50337d4ad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7f08491590244569509d7a5c9a59fd0, role_id=83f47e3fe65f49a0b3edb0d175242e96)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:53.724879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05d471-8bc3-4228-873e-4bf50337d4ad None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:53.740519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 164/334] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Sep 1 00:16:53 2022] PUT /identity/v3/system/users/e7f08491590244569509d7a5c9a59fd0/roles/83f47e3fe65f49a0b3edb0d175242e96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:16:55.183656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ba522-0f6d-43dc-a440-cd9e0162bc9b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:55.184715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ba522-0f6d-43dc-a440-cd9e0162bc9b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:55.185203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ba522-0f6d-43dc-a440-cd9e0162bc9b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:55.186957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 171/335] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:55.192687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093d2c0-97ff-416a-aca3-f8348a97f13a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:55.193202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093d2c0-97ff-416a-aca3-f8348a97f13a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:55.193202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093d2c0-97ff-416a-aca3-f8348a97f13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:55.221490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7093d2c0-97ff-416a-aca3-f8348a97f13a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:55.222786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7093d2c0-97ff-416a-aca3-f8348a97f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:55.296768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 165/336] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:55.488600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b98fd-811c-48b6-8088-1117ebfad5b9 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:55.489288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b98fd-811c-48b6-8088-1117ebfad5b9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:55.489806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b98fd-811c-48b6-8088-1117ebfad5b9 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:55.492107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 172/337] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:55.497183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7c94-0141-40be-8036-a5761aab1253 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:55.497769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7c94-0141-40be-8036-a5761aab1253 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:55.498249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7c94-0141-40be-8036-a5761aab1253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:55.529445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-3e9c7c94-0141-40be-8036-a5761aab1253 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:55.530634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3e9c7c94-0141-40be-8036-a5761aab1253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:55.612303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 166/338] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:55.756614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0526cb-1d51-4786-a630-cf4581810ff3 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:55.756795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0526cb-1d51-4786-a630-cf4581810ff3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:55.757054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0526cb-1d51-4786-a630-cf4581810ff3 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:55.759054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 173/339] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:55.764312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c7c94-0141-40be-8036-a5761aab1253 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:55.778209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f49b7-462c-4068-8eb7-f43e58b13b63 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:55.778522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f49b7-462c-4068-8eb7-f43e58b13b63 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:55.778741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f49b7-462c-4068-8eb7-f43e58b13b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:55.809174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ac4f49b7-462c-4068-8eb7-f43e58b13b63 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:55.810381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ac4f49b7-462c-4068-8eb7-f43e58b13b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:55.868059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:55.950489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 174/340] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:16:55.952082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f49b7-462c-4068-8eb7-f43e58b13b63 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:55.961189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c7c94-0141-40be-8036-a5761aab1253 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:55.992748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:56.042814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:56.043678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.044121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.047622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.069320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:56.077667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:56.078790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:56.079787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 167/341] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:56.099633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:56.128242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f49b7-462c-4068-8eb7-f43e58b13b63 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:56.180696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:56.181731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.182194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.182608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.199026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:56.204937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:56.206019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:56.207015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:56.213588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 175/342] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:56.219349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:56.340488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:56.348305 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5999e49-72c5-4e46-b044-acfb13850741 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:56.404004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533025f1-7146-47ea-a10e-254f9cb446a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:56.404676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533025f1-7146-47ea-a10e-254f9cb446a3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.404957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533025f1-7146-47ea-a10e-254f9cb446a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.405229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533025f1-7146-47ea-a10e-254f9cb446a3 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.406265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533025f1-7146-47ea-a10e-254f9cb446a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:56.406582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533025f1-7146-47ea-a10e-254f9cb446a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:56.407982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533025f1-7146-47ea-a10e-254f9cb446a3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:56.420786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 176/343] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:56.422028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e10e-c574-4af0-93bc-e88a10fb69f1 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.422324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e10e-c574-4af0-93bc-e88a10fb69f1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.422583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e10e-c574-4af0-93bc-e88a10fb69f1 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.423761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 177/344] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:56.424468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03c3e-27be-49c3-b1f5-cf098be0fc6f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:56.424919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e10e-c574-4af0-93bc-e88a10fb69f1 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:56.445311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:56.487323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a4ae5-f97d-4035-be76-6918cc3c538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:56.487977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a4ae5-f97d-4035-be76-6918cc3c538b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.488252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a4ae5-f97d-4035-be76-6918cc3c538b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.488544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a4ae5-f97d-4035-be76-6918cc3c538b None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.489260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a4ae5-f97d-4035-be76-6918cc3c538b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:56.489557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a4ae5-f97d-4035-be76-6918cc3c538b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:56.491018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a4ae5-f97d-4035-be76-6918cc3c538b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:56.500638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 168/345] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:56.501923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b987b1b-4690-49dd-952c-fc2ef1507c9e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.502204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b987b1b-4690-49dd-952c-fc2ef1507c9e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.502499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b987b1b-4690-49dd-952c-fc2ef1507c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.523520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5b987b1b-4690-49dd-952c-fc2ef1507c9e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:56.523520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5b987b1b-4690-49dd-952c-fc2ef1507c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:56.552953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e10e-c574-4af0-93bc-e88a10fb69f1 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:56.590866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:56.591427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.591705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.591991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.604227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 169/346] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:56.605426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b987b1b-4690-49dd-952c-fc2ef1507c9e None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:56.610359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:56.615999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:56.617038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:16:56.617939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:56.620598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 178/347] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:56.621434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:56.629577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:56.721924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:56.725678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b987b1b-4690-49dd-952c-fc2ef1507c9e None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:56.785358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:56.786407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.786899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.787395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.825616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6339e42-cf75-4131-aeae-7607617c90a8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:56.889022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:56.889557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:56.889836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:56.890109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:56.937921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:56.939395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:57.021302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:57.023355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:57.028157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.090787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.097027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 170/348] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:57.098094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.153551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 179/349] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:57.154477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.220496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd939b-9052-4dc1-b6a5-bae7b4a20736 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:57.266891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50314c-62d1-4840-a192-d82c326a5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:57.267499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50314c-62d1-4840-a192-d82c326a5bcf None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.268191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50314c-62d1-4840-a192-d82c326a5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.268599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50314c-62d1-4840-a192-d82c326a5bcf None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.269547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50314c-62d1-4840-a192-d82c326a5bcf None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:57.269848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50314c-62d1-4840-a192-d82c326a5bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:57.271751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50314c-62d1-4840-a192-d82c326a5bcf None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:57.283464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 171/350] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:57.285395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b287b1-f2c7-48bf-9bea-10527142da40 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.285745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b287b1-f2c7-48bf-9bea-10527142da40 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.286172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b287b1-f2c7-48bf-9bea-10527142da40 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.288210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 172/351] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:57.289497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b287b1-f2c7-48bf-9bea-10527142da40 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.299697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4005-741f-47f7-b919-c5d48199f973 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:57.302333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.349762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:57.350449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.350733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.351534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.370402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:57.375372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:57.376271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:16:57.377175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 180/352] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:57.377840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.389797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.449206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b287b1-f2c7-48bf-9bea-10527142da40 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:57.494857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:57.496577 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.497083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.497520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.499741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:57.501425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:57.503230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 173/353] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:57.504215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.506955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bde0a-9d86-486e-b3a9-f6d0656be010 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:57.552118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad5d30-e787-41b4-8e4e-88e6b34070ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:57.553033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5d30-e787-41b4-8e4e-88e6b34070ce None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.553260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5d30-e787-41b4-8e4e-88e6b34070ce None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.553530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5d30-e787-41b4-8e4e-88e6b34070ce None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.555183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad5d30-e787-41b4-8e4e-88e6b34070ce None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:57.556770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad5d30-e787-41b4-8e4e-88e6b34070ce None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:57.558858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 181/354] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:57.560011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f31d0-7195-4d84-8cfb-c0a5514770cd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.560295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f31d0-7195-4d84-8cfb-c0a5514770cd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.560588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f31d0-7195-4d84-8cfb-c0a5514770cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.579578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-125f31d0-7195-4d84-8cfb-c0a5514770cd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:57.580850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-125f31d0-7195-4d84-8cfb-c0a5514770cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:57.611505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.634062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ea8ff-2e5e-40d6-9832-c1d2f6276d70 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:57.660895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 182/355] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:57.661805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f31d0-7195-4d84-8cfb-c0a5514770cd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.674335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.683093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb808b8-2c52-4f79-93ce-a0b5490d63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:57.683698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb808b8-2c52-4f79-93ce-a0b5490d63f9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.683972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb808b8-2c52-4f79-93ce-a0b5490d63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.684237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb808b8-2c52-4f79-93ce-a0b5490d63f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.777334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb808b8-2c52-4f79-93ce-a0b5490d63f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:57.778731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb808b8-2c52-4f79-93ce-a0b5490d63f9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:57.789658 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f31d0-7195-4d84-8cfb-c0a5514770cd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:57.837517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:57.838168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.838443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.838710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.839380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:57.839679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:57.841144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:57.854659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 183/356] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:57.855315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.885252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.909935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 174/357] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:57.911707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8b9c-3da3-4b0d-a67a-0317808e1300 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:57.912089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8b9c-3da3-4b0d-a67a-0317808e1300 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:57.912494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8b9c-3da3-4b0d-a67a-0317808e1300 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:57.914917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 175/358] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:16:57.915701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd8b9c-3da3-4b0d-a67a-0317808e1300 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:57.955413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:57.987938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0f854-7d74-4d20-be3f-02d4fe451178 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.033485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.035105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.035105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.035105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.041607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.042939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd8b9c-3da3-4b0d-a67a-0317808e1300 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.043105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.044939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 184/359] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.049346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.086901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.087542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.087966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.088254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.090370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.092889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.093000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 176/360] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:16:57 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.093711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.154855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:58.168263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee4b80-9892-405e-8993-ff9c87813a5e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.211170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:58.213321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd364d-6ecd-4c00-8d0a-63d3ab476b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.214127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd364d-6ecd-4c00-8d0a-63d3ab476b81 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.214409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd364d-6ecd-4c00-8d0a-63d3ab476b81 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.214686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd364d-6ecd-4c00-8d0a-63d3ab476b81 None admin] PATH_INFO: `/v3/users/e7f08491590244569509d7a5c9a59fd0` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.215849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd364d-6ecd-4c00-8d0a-63d3ab476b81 None admin] RBAC: Authorizing `identity:get_user(user_id=e7f08491590244569509d7a5c9a59fd0)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.216194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065459-96b8-4c0e-a049-38774320d1a0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.217480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd364d-6ecd-4c00-8d0a-63d3ab476b81 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.219380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 185/361] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/users/e7f08491590244569509d7a5c9a59fd0 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.220220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7a619-4a77-4295-bed8-2bd4b9e34a42 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.220533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7a619-4a77-4295-bed8-2bd4b9e34a42 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.220808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7a619-4a77-4295-bed8-2bd4b9e34a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.240779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-78b7a619-4a77-4295-bed8-2bd4b9e34a42 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:16:58.242582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-78b7a619-4a77-4295-bed8-2bd4b9e34a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:16:58.253367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.253675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.253923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.254198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.255435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.258153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.260077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 177/362] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.260729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.334347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 186/363] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:16:58.335280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7a619-4a77-4295-bed8-2bd4b9e34a42 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.386067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6c3b-70eb-4e19-9110-5d668db551dd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.430457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.431087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.431362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.431628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.443255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:58.444765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:58.448213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:58.449289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 178/364] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:58.450519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.473279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7a619-4a77-4295-bed8-2bd4b9e34a42 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.488830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:58.519005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.519203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.519593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.519762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.523931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=42931b58092d490eb3e62614a2778775, scope.project.id=06ab6cdbc24841e085a006b817751fea) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:58.523931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.523931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.531567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 187/365] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=42931b58092d490eb3e62614a2778775 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.532024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.635269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76882ac-803c-4a90-99f9-044fbf808ebd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.668519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5c34-1a20-4485-8297-8cdb27c2835c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.683156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.683767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.684150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.684436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.685177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=06ab6cdbc24841e085a006b817751fea) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:58.685664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.687145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.697530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 179/366] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.698399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.722126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.722768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.723038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.723316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.724086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] RBAC: Adding query filter params (role.id=83f47e3fe65f49a0b3edb0d175242e96, user.id=e7f08491590244569509d7a5c9a59fd0, scope.system=all) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:58.724420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.728334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.754904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 188/367] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/role_assignments?user.id=e7f08491590244569509d7a5c9a59fd0&scope.system=all&role.id=83f47e3fe65f49a0b3edb0d175242e96 => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.755819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.777911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:58.908348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22949aa-f988-4cbb-8404-ba189fdd0e79 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.910892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:58.919102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c074d91-f77e-493b-ba7f-dbffee7fae50 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:58.955679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.956885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.957340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.957811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.958652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:58.959123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.960675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:58.961121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.961439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:58.961801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:58.962160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:58.964253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:58.965919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:58.967761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 180/368] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.968796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:58.972251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 189/369] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:58.975858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:59.074216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:59.111478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93e31-b60e-4b2b-af30-f5aa71816bd8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:59.117321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418bcbb-8f9c-4aa4-8f1d-6ec6f719452e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:59.155063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:59.155866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:59.156212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:59.156643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:59.163860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:59.164930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:59.165678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:59.166127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:59.167056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=42931b58092d490eb3e62614a2778775, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:59.167668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:59.169478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:59.169664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:16:59.175251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:16:59.176168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:16:59.177000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 181/370] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:16:59.177647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:59.179932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 190/371] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:16:58 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=42931b58092d490eb3e62614a2778775 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:16:59.186139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:59.222275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:59.311948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c47d4-dd55-43ac-af9f-ceef82d8e2a8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:59.354504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:59.356328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:59.356787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:59.357201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:59.358127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:16:59.358572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:59.360469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:59.362541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:59.379598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 191/372] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:16:59.385255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:59.390591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13394863-9ac7-4d7a-a64a-af0af53c71e9 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:59.453475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:59.454126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:59.454385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:59.454634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:59.580125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f30c53-f7d2-4104-bd7c-a170ad7bd814 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:16:59.586647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:59.588135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:59.621029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:59.640742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:16:59.641356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:16:59.641635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:16:59.641903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:16:59.754726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:16:59.765606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:16:59.767087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:16:59.780560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 182/373] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:16:59.781493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:59.933271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 192/374] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:16:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:16:59.939648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:16:59.997516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8907d-d8e7-4b67-b007-615c26634dfe None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:00.033872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:00.051155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:00.060281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268684-a828-479d-831e-d4ee14a58e10 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:00.070270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:00.071354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.071354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.071545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.072746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:00.074318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:00.076368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 183/375] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:59 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:00.082493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:00.102621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:00.103756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.104243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.104815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] PATH_INFO: `/v3/projects/00e0be78705643f38f372c4bbaf2a54a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.106091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] RBAC: Authorizing `identity:get_project(project_id=00e0be78705643f38f372c4bbaf2a54a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:00.107672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:00.109886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 193/376] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:16:59 2022] GET /identity/v3/projects/00e0be78705643f38f372c4bbaf2a54a => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:00.116214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:00.235979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143bfca-caa9-4faa-8771-415af8654723 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:00.266243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c463b-f180-40b2-8555-95f72dd4fff5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:00.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:00.278127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.278546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.279002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] PATH_INFO: `/v3/groups/d1f79097b32c446eba869f5a63f23a64` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.285662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] RBAC: Authorizing `identity:get_group(group_id=d1f79097b32c446eba869f5a63f23a64)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:00.287332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:00.290259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 194/377] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:00 2022] GET /identity/v3/groups/d1f79097b32c446eba869f5a63f23a64 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:00.296779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:00.330417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:00.335557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:00.336198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.336500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.336772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.338431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:00.339997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:00.350191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 184/378] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:00 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:00.356599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:00.415892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb63cc-5a59-4ca8-aef3-a857908284fd None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:00.456629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4656c-0a9d-4ca0-adf3-4be688a69c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:00.457927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4656c-0a9d-4ca0-adf3-4be688a69c11 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.458372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4656c-0a9d-4ca0-adf3-4be688a69c11 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.458782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4656c-0a9d-4ca0-adf3-4be688a69c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.459645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4656c-0a9d-4ca0-adf3-4be688a69c11 None admin] RBAC: Adding query filter params (group.id=d1f79097b32c446eba869f5a63f23a64, role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=00e0be78705643f38f372c4bbaf2a54a) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:00.460181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4656c-0a9d-4ca0-adf3-4be688a69c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:00.462187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4656c-0a9d-4ca0-adf3-4be688a69c11 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:00.463338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:00.471036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 195/379] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:17:00 2022] GET /identity/v3/role_assignments?group.id=d1f79097b32c446eba869f5a63f23a64&scope.project.id=00e0be78705643f38f372c4bbaf2a54a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:00.547959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa859-00df-43c6-a0fd-8401ba338103 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:00.586849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2456-556c-46fe-9cf7-c8206ef64526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:00.587606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2456-556c-46fe-9cf7-c8206ef64526 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.587886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2456-556c-46fe-9cf7-c8206ef64526 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.588152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2456-556c-46fe-9cf7-c8206ef64526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.588917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc2456-556c-46fe-9cf7-c8206ef64526 None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:00.589221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc2456-556c-46fe-9cf7-c8206ef64526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:00.590664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc2456-556c-46fe-9cf7-c8206ef64526 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:00.597453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 185/380] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:17:00 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:00.756292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa8406-a7a5-4fb4-a70d-8efcb52b2bd3 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.756720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa8406-a7a5-4fb4-a70d-8efcb52b2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.756919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa8406-a7a5-4fb4-a70d-8efcb52b2bd3 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.758654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 196/381] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:00.764259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53fc9-bd52-4584-ab74-ab409660f871 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:00.764578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53fc9-bd52-4584-ab74-ab409660f871 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:00.764853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53fc9-bd52-4584-ab74-ab409660f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:00.789219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-90b53fc9-bd52-4584-ab74-ab409660f871 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:00.790422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-90b53fc9-bd52-4584-ab74-ab409660f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:00.894897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 186/382] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:01.102655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b09a-fae9-4d82-84cf-fb32bc0bef8b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.103036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b09a-fae9-4d82-84cf-fb32bc0bef8b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.103212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b09a-fae9-4d82-84cf-fb32bc0bef8b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.105095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 197/383] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:01.110604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4065-ada8-42cc-900d-a562e479d23f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.110900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4065-ada8-42cc-900d-a562e479d23f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.111177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4065-ada8-42cc-900d-a562e479d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.141439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ce7d4065-ada8-42cc-900d-a562e479d23f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:01.142631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ce7d4065-ada8-42cc-900d-a562e479d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:01.192799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:01.222043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 187/384] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:01.228284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493b09a-fae9-4d82-84cf-fb32bc0bef8b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:01.360528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:01.372150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493b09a-fae9-4d82-84cf-fb32bc0bef8b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:01.418023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:01.418778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.418944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.419268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.432633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:01.438041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:01.438908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:01.439713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 198/385] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:01.446692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4065-ada8-42cc-900d-a562e479d23f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:01.602423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4065-ada8-42cc-900d-a562e479d23f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:01.643774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:01.652495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:01.653114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.653388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.653654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.654315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:01.654608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:01.655992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:01.668834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 188/386] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:17:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:01.677383 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:01.772305 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d736567-b6ed-4d5a-8406-c737a6c7e073 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:01.776758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:01.813496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66868c54-304f-4d0d-acce-b0b770c9e1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:01.814136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868c54-304f-4d0d-acce-b0b770c9e1be None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.814414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868c54-304f-4d0d-acce-b0b770c9e1be None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.814686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868c54-304f-4d0d-acce-b0b770c9e1be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.838851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66868c54-304f-4d0d-acce-b0b770c9e1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-66868c54-304f-4d0d-acce-b0b770c9e1be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:01.845971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:01.846880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:01.848064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 199/387] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:01.848997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14176ae-6e46-4ff1-9b58-e3fdd0c16a2d None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.848997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14176ae-6e46-4ff1-9b58-e3fdd0c16a2d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.849120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14176ae-6e46-4ff1-9b58-e3fdd0c16a2d None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.854591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 200/388] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:01.855814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14176ae-6e46-4ff1-9b58-e3fdd0c16a2d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:01.873538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:01.882831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4ce47-598a-4d3e-99f7-140ff64e8a3f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:01.919887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2a9be-82b1-4225-86f5-d1bc3fb0098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:01.921005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2a9be-82b1-4225-86f5-d1bc3fb0098a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.921489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2a9be-82b1-4225-86f5-d1bc3fb0098a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.921987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2a9be-82b1-4225-86f5-d1bc3fb0098a None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.923394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2a9be-82b1-4225-86f5-d1bc3fb0098a None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:01.925209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2a9be-82b1-4225-86f5-d1bc3fb0098a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:01.926988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 189/389] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:01 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:01.928711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f447df-e9f5-4baa-aa8a-dee00e154866 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:01.929274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f447df-e9f5-4baa-aa8a-dee00e154866 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:01.929747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f447df-e9f5-4baa-aa8a-dee00e154866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:01.948964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c5f447df-e9f5-4baa-aa8a-dee00e154866 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:01.950440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c5f447df-e9f5-4baa-aa8a-dee00e154866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:01.964495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14176ae-6e46-4ff1-9b58-e3fdd0c16a2d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.011711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.012692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.013150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.013697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.014729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:02.015231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:02.016893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:02.027706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 201/390] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:02.028822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:02.037041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 190/391] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:02.038481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f447df-e9f5-4baa-aa8a-dee00e154866 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:02.096873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:02.156970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:02.178517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5768-d75e-4b1d-9b2e-fd1300945e44 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.186426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f447df-e9f5-4baa-aa8a-dee00e154866 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.216826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.217462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.217744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.218018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.219278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:02.220749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:02.224640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 202/392] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:02 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:02.228374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:02.258783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.259346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.259620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.259891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.262201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:02.263642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:02.265267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 191/393] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:02 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:02.271215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:02.385015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520381de-907a-425b-89c7-2fcc4f551bd6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.428835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.429657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.429949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.432403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea/groups/47be00d1d674483fb1f37770be0de959/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.432403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] RBAC: Authorizing `identity:create_grant(project_id=06ab6cdbc24841e085a006b817751fea, group_id=47be00d1d674483fb1f37770be0de959, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:02.433882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:02.443665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b52f4-ca69-408c-9892-dd4aeb4f1b59 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.450586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 203/394] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Sep 1 00:17:02 2022] PUT /identity/v3/projects/06ab6cdbc24841e085a006b817751fea/groups/47be00d1d674483fb1f37770be0de959/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:17:02.451597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:02.453510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:02.457166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:02.529212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.529654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.530024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.530277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.532579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:02.533961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:02.544540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 192/395] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:02 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:02.551419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:02.667976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebc7e0-68c0-4ede-8ba2-0f877460ade9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.703081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafda3-30af-4e2c-8240-97c5fc83e899 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.708164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd827-d674-4e25-99b4-ab7eec79a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.708837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd827-d674-4e25-99b4-ab7eec79a8af None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.709116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd827-d674-4e25-99b4-ab7eec79a8af None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.709385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd827-d674-4e25-99b4-ab7eec79a8af None admin] PATH_INFO: `/v3/roles/member` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.721374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd827-d674-4e25-99b4-ab7eec79a8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-16dcd827-d674-4e25-99b4-ab7eec79a8af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:02.726763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:02.727678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:02.729071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 204/396] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:02.730151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512f88-a9eb-484e-85d0-8e5373eab390 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.730151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512f88-a9eb-484e-85d0-8e5373eab390 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.730151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512f88-a9eb-484e-85d0-8e5373eab390 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.731445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 205/397] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:02.742322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192dabd-82bf-4dc1-ad76-368afe415682 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.742606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192dabd-82bf-4dc1-ad76-368afe415682 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.742876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192dabd-82bf-4dc1-ad76-368afe415682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.745631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.746292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.746569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.746844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea/groups/47be00d1d674483fb1f37770be0de959/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.749044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] RBAC: Authorizing `identity:create_grant(project_id=06ab6cdbc24841e085a006b817751fea, group_id=47be00d1d674483fb1f37770be0de959, role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:02.750482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:02.762676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-9192dabd-82bf-4dc1-ad76-368afe415682 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:02.764035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9192dabd-82bf-4dc1-ad76-368afe415682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:02.772508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 193/398] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Sep 1 00:17:02 2022] PUT /identity/v3/projects/06ab6cdbc24841e085a006b817751fea/groups/47be00d1d674483fb1f37770be0de959/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:02.773990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:02.863409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:02.894659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:02.913319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 206/399] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:02.953137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7198b-457d-45b7-99a6-0aa4abf71f24 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:02.988782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:02.989460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:02.989737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:02.990006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:02.990665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:02.990962 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:02.992956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:03.001724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec01c-b4f9-49ed-8a94-6eb591336ffb None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.002005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec01c-b4f9-49ed-8a94-6eb591336ffb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.002278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec01c-b4f9-49ed-8a94-6eb591336ffb None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.002660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 194/400] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:17:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:03.003915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 207/401] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:17:03.008300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.009412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9046-3892-4064-ab53-5f0973e37464 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.009691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9046-3892-4064-ab53-5f0973e37464 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.009964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9046-3892-4064-ab53-5f0973e37464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.047449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0f4f9046-3892-4064-ab53-5f0973e37464 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:03.049012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0f4f9046-3892-4064-ab53-5f0973e37464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:03.112622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:03.120527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650eb8-b43c-402c-9582-14d383966293 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.175841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:03.176554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.176829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.177092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.180490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 208/402] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:17:03.181089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:03.182539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:03.184454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 195/403] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:03.193627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f9046-3892-4064-ab53-5f0973e37464 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.308374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f9046-3892-4064-ab53-5f0973e37464 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.332899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:03.344985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:03.345621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.345900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.346175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.347304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:03.348803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:03.351310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 209/404] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:03.352941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.370255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.467770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce39b-c75e-48ab-bf19-0c95f7355a4f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.506347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:03.507044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0298262-5b34-40c3-b3b2-1c921a800f0b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.507892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.508502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.508991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.523681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:03.532775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:03.533688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:03.534486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 196/405] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:03.540474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.559624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:03.560590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.561126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.561716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/groups/47be00d1d674483fb1f37770be0de959/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.563878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] RBAC: Authorizing `identity:create_grant(project_id=3e0261df5d904c07b66cfae0c5073d2f, group_id=47be00d1d674483fb1f37770be0de959, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:03.565758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:03.572343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:03.584310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 210/406] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Sep 1 00:17:03 2022] PUT /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/groups/47be00d1d674483fb1f37770be0de959/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:17:03.589593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.658539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de5424-4f31-4ebc-a823-4d46e2a6f009 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.681632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:03.700936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:03.701943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.702439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.702964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.716190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:03.722573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:03.723522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:03.724319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:03.727291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 197/407] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:03.736498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.768098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f224-7a34-40f6-b24d-23c45f38fd5c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.812140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:03.812140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.812140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.812140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.812557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:03.812557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:03.812557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:03.820890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 211/408] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:03.828969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:03.898452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:03.922640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348896c8-8220-4a86-83dd-4613dab8a1f5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.967063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:03.968063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:03.968602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:03.969075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:03.970010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:03.970562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:03.972161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:03.985687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 198/409] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:03.987291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf8fc0-739f-4599-b31d-4c50258bce10 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:03.991589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:04.020760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:04.028001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:04.029124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.029423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.029708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] PATH_INFO: `/v3/groups/d1f79097b32c446eba869f5a63f23a64` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.031281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] RBAC: Authorizing `identity:get_group(group_id=d1f79097b32c446eba869f5a63f23a64)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:04.032852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:04.035370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 212/410] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/groups/d1f79097b32c446eba869f5a63f23a64 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:04.041944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:04.154575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09b836-5a77-4269-a693-5a776531fb2c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:04.191444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:04.192085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.192365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.192664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] PATH_INFO: `/v3/projects/00e0be78705643f38f372c4bbaf2a54a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.194195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] RBAC: Authorizing `identity:get_project(project_id=00e0be78705643f38f372c4bbaf2a54a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:04.196195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:04.203536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 213/411] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:04 2022] GET /identity/v3/projects/00e0be78705643f38f372c4bbaf2a54a => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:04.209606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:04.268365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ace77-c6dd-4791-b9f9-16def36680d4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:04.295193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:04.352062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bdd91-e63c-4a39-a82a-5d0da8d6c090 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:04.360130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:04.360635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.361037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.361383 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.362582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:04.364139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:04.366128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 199/412] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:03 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:04.371785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:04.399710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:04.401917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.402403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.403948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] PATH_INFO: `/v3/projects/00e0be78705643f38f372c4bbaf2a54a/groups/d1f79097b32c446eba869f5a63f23a64/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.405347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:04.409581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] RBAC: Authorizing `identity:create_grant(project_id=00e0be78705643f38f372c4bbaf2a54a, group_id=d1f79097b32c446eba869f5a63f23a64, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:04.413098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:04.438961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 214/413] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Sep 1 00:17:04 2022] PUT /identity/v3/projects/00e0be78705643f38f372c4bbaf2a54a/groups/d1f79097b32c446eba869f5a63f23a64/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:04.538911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ef221-b828-4dbc-a39f-63c59c71f482 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:04.577971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b1dcb-1880-4132-8a65-fc9c9a9b403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:04.578612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1dcb-1880-4132-8a65-fc9c9a9b403c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.578885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1dcb-1880-4132-8a65-fc9c9a9b403c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.579206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1dcb-1880-4132-8a65-fc9c9a9b403c None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.580339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b1dcb-1880-4132-8a65-fc9c9a9b403c None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:04.581995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b1dcb-1880-4132-8a65-fc9c9a9b403c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:04.584081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 200/414] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:04 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:04.589538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:04.693786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a7fb-9765-4f79-aa49-ead5be53c4bc None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:04.705666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:04.739419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a3c9f-fb7e-4fab-a23c-877e65e19e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:04.740086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a3c9f-fb7e-4fab-a23c-877e65e19e31 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.740363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a3c9f-fb7e-4fab-a23c-877e65e19e31 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.740659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a3c9f-fb7e-4fab-a23c-877e65e19e31 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/groups/47be00d1d674483fb1f37770be0de959/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.742930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a3c9f-fb7e-4fab-a23c-877e65e19e31 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e0261df5d904c07b66cfae0c5073d2f, group_id=47be00d1d674483fb1f37770be0de959, role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:04.744356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a3c9f-fb7e-4fab-a23c-877e65e19e31 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:04.761811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 215/415] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Sep 1 00:17:04 2022] PUT /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f/groups/47be00d1d674483fb1f37770be0de959/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:04.927308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb491d-3124-4586-bd48-e85f6f03e2e2 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.927865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb491d-3124-4586-bd48-e85f6f03e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.927865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb491d-3124-4586-bd48-e85f6f03e2e2 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.929660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 201/416] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:04.934948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025a92-4208-4081-a3e4-3934f5ee6f23 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:04.935229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025a92-4208-4081-a3e4-3934f5ee6f23 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:04.935490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025a92-4208-4081-a3e4-3934f5ee6f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:04.954313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2c025a92-4208-4081-a3e4-3934f5ee6f23 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:04.955424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2c025a92-4208-4081-a3e4-3934f5ee6f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:05.039049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 216/417] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:05.077339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c152-509c-4cb9-8e50-a6e09da4f7cc None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:05.077656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c152-509c-4cb9-8e50-a6e09da4f7cc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:05.077936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c152-509c-4cb9-8e50-a6e09da4f7cc None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:05.079584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 202/418] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:05.086645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3b1c-e5d2-44b4-bfa8-123a0acdc078 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:05.086929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3b1c-e5d2-44b4-bfa8-123a0acdc078 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:05.087199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3b1c-e5d2-44b4-bfa8-123a0acdc078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:05.107705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ed4a3b1c-e5d2-44b4-bfa8-123a0acdc078 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:05.108916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ed4a3b1c-e5d2-44b4-bfa8-123a0acdc078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:05.189071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 217/419] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:17:05.370013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322c152-509c-4cb9-8e50-a6e09da4f7cc None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:05.477908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:05.505115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322c152-509c-4cb9-8e50-a6e09da4f7cc None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:05.553747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:05.554414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:05.554693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:05.554961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:05.563870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3b1c-e5d2-44b4-bfa8-123a0acdc078 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:05.578946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:05.584921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:05.586432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:05.587277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:05.591326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 203/420] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:05.596980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:05.617048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:05.724508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3b1c-e5d2-44b4-bfa8-123a0acdc078 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:05.762845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:05.763906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:05.764410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:05.764893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:05.776724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:05.781874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:05.782794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:05.783593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:05.786232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 218/421] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:05.792181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:05.804922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7157f-01ec-4309-baaa-167d623acf71 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:05.868825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:05.869438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:05.869717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:05.869992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:05.870663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] RBAC: Adding query filter params (name=member) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:05.870965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:05.872367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:05.887466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:05.893703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 204/422] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:17:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:05.900803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ef883-99e5-4351-af63-3fb1b4d59bbb None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:05.900939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:05.909503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:05.942219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:05.943817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:05.944553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:05.945029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:05.945972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:05.946494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:05.948089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:05.958256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 219/423] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:05.965694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:06.092720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df72d2-26c2-43b8-a4f9-c8ec7ebcd280 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:06.144936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58db2-adf3-4717-85f2-e7f7928b75c0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:06.149063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248f786-99ca-491e-9985-d0ae8dbd4414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:06.149932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248f786-99ca-491e-9985-d0ae8dbd4414 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.150417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248f786-99ca-491e-9985-d0ae8dbd4414 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.150889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248f786-99ca-491e-9985-d0ae8dbd4414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.180887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeac7b-43df-44a6-b4c6-7648ddc35f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:06.181550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeac7b-43df-44a6-b4c6-7648ddc35f9e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.181859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeac7b-43df-44a6-b4c6-7648ddc35f9e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.182135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeac7b-43df-44a6-b4c6-7648ddc35f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.203273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:06.224015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248f786-99ca-491e-9985-d0ae8dbd4414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:06.226474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248f786-99ca-491e-9985-d0ae8dbd4414 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:06.229731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:06.263338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeac7b-43df-44a6-b4c6-7648ddc35f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:06.265284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeac7b-43df-44a6-b4c6-7648ddc35f9e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:06.340412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 205/424] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:17:06.340412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca9b9c-acd7-458a-b472-8666f9cce13a None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.340412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca9b9c-acd7-458a-b472-8666f9cce13a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.340412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca9b9c-acd7-458a-b472-8666f9cce13a None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.340412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 206/425] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:06.340412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca9b9c-acd7-458a-b472-8666f9cce13a None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:06.386867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 220/426] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:06.388335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056051f-cd2a-476c-b56c-b9558c84c85d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.388886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056051f-cd2a-476c-b56c-b9558c84c85d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.389379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056051f-cd2a-476c-b56c-b9558c84c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.408042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1056051f-cd2a-476c-b56c-b9558c84c85d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:06.409740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1056051f-cd2a-476c-b56c-b9558c84c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:06.451099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca9b9c-acd7-458a-b472-8666f9cce13a None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:06.453516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:06.464433 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:06.487207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:06.487885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.488165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.488460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.489586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:06.496616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:06.496886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 221/428] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:06.497967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 207/428] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:06 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:06.498078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056051f-cd2a-476c-b56c-b9558c84c85d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:06.498830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:06.620076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e96663-b6b4-42ed-a238-adc895e87895 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:06.633879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056051f-cd2a-476c-b56c-b9558c84c85d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:06.657778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f712fd4-ab4f-4d37-8623-9ca0a5ed58a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:06.658391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f712fd4-ab4f-4d37-8623-9ca0a5ed58a9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.658665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f712fd4-ab4f-4d37-8623-9ca0a5ed58a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.658933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f712fd4-ab4f-4d37-8623-9ca0a5ed58a9 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.660113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f712fd4-ab4f-4d37-8623-9ca0a5ed58a9 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:06.661584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f712fd4-ab4f-4d37-8623-9ca0a5ed58a9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:06.663551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 208/429] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:06 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:06.669391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c59f-dbdb-4522-b49b-9126d455e3a5 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.669679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c59f-dbdb-4522-b49b-9126d455e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.669950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c59f-dbdb-4522-b49b-9126d455e3a5 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.671512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 209/430] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:06.672284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352c59f-dbdb-4522-b49b-9126d455e3a5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:06.675090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3c8b2-5edc-4895-b288-eb178913ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:06.676089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3c8b2-5edc-4895-b288-eb178913ab1e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.676615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3c8b2-5edc-4895-b288-eb178913ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.677105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3c8b2-5edc-4895-b288-eb178913ab1e None admin] PATH_INFO: `/v3/projects/06ab6cdbc24841e085a006b817751fea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.678458 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3c8b2-5edc-4895-b288-eb178913ab1e None admin] RBAC: Authorizing `identity:get_project(project_id=06ab6cdbc24841e085a006b817751fea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:06.680687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3c8b2-5edc-4895-b288-eb178913ab1e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:06.682639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 222/431] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:06 2022] GET /identity/v3/projects/06ab6cdbc24841e085a006b817751fea => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:06.684068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0a1d-5eeb-437f-b0e8-53611f21b8ed None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.684584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0a1d-5eeb-437f-b0e8-53611f21b8ed None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.685075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0a1d-5eeb-437f-b0e8-53611f21b8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.704172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cecd0a1d-5eeb-437f-b0e8-53611f21b8ed None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:06.705782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cecd0a1d-5eeb-437f-b0e8-53611f21b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:06.722732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:06.758640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:06.787307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 223/432] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:06.787714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352c59f-dbdb-4522-b49b-9126d455e3a5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:06.788801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd0a1d-5eeb-437f-b0e8-53611f21b8ed None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:06.824170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:06.824858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.825135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.825407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.826128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=42931b58092d490eb3e62614a2778775, scope.project.id=06ab6cdbc24841e085a006b817751fea) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:06.826477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:06.828145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:06.834442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 210/433] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:17:06 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=42931b58092d490eb3e62614a2778775 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:06.916917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd0a1d-5eeb-437f-b0e8-53611f21b8ed None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:06.917857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:06.955947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:06.957006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:06.957505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:06.958065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:06.959472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:06.961953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:06.964438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 224/434] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:06 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:06.973421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.035053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.094738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536915-bfad-4c0e-892e-5c616821dd93 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.098035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.117154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854413-cf94-4518-9619-97b97eba4ff6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.135326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.135967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.136348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.136648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] PATH_INFO: `/v3/roles/member` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.147632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:07.153772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:07.154718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:07.155531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 211/435] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:07.156210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.173189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.174131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.175306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.175865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.176882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=06ab6cdbc24841e085a006b817751fea) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:07.177437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:07.178934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:07.186113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 225/436] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:17:06 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=06ab6cdbc24841e085a006b817751fea&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:07.186930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.290913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1991f-82d2-4042-9599-53b46cf2effd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.325561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79348-faf4-49c6-8331-55f2bba10cda None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.332650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f21c3b-210f-4be9-a98a-c4fc5036b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.334207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21c3b-210f-4be9-a98a-c4fc5036b147 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.334727 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21c3b-210f-4be9-a98a-c4fc5036b147 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.335723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f21c3b-210f-4be9-a98a-c4fc5036b147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.344957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.354522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f21c3b-210f-4be9-a98a-c4fc5036b147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-78f21c3b-210f-4be9-a98a-c4fc5036b147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:07.360990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:07.361899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:07.362695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:07.363783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 212/437] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:07.364236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36939b-07ba-43c2-b019-f6bfa3ef36e5 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.364342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36939b-07ba-43c2-b019-f6bfa3ef36e5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.364734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36939b-07ba-43c2-b019-f6bfa3ef36e5 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.365981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 213/438] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:07.369179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36939b-07ba-43c2-b019-f6bfa3ef36e5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.369294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd9e9c-2d86-4a84-be2e-c9ffe4c7e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.369941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd9e9c-2d86-4a84-be2e-c9ffe4c7e34c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.370157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd9e9c-2d86-4a84-be2e-c9ffe4c7e34c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.370431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd9e9c-2d86-4a84-be2e-c9ffe4c7e34c None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.371102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd9e9c-2d86-4a84-be2e-c9ffe4c7e34c None admin] RBAC: Adding query filter params (name=member) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:07.371407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd9e9c-2d86-4a84-be2e-c9ffe4c7e34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:07.372857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd9e9c-2d86-4a84-be2e-c9ffe4c7e34c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:07.383340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 226/439] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:17:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:07.384990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85e6ad-0236-4532-87f7-c31f68bf4f76 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.385507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85e6ad-0236-4532-87f7-c31f68bf4f76 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.386016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85e6ad-0236-4532-87f7-c31f68bf4f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.400258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.407528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7a85e6ad-0236-4532-87f7-c31f68bf4f76 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:07.408742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7a85e6ad-0236-4532-87f7-c31f68bf4f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:07.487632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36939b-07ba-43c2-b019-f6bfa3ef36e5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.492756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 227/440] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:07.493666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85e6ad-0236-4532-87f7-c31f68bf4f76 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.542115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.542731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.543009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.543280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.543945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:07.544244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:07.546356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:07.556852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 214/441] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:07.562361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.629247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85e6ad-0236-4532-87f7-c31f68bf4f76 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.630803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.665328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.678741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.679448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.679799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.680142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.687622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee068c-7912-418a-a7be-da95363b2655 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.724326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.724970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.725248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.726039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.758781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:07.760511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:07.796571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:07.798022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:07.860109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 228/442] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:07.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.863174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.884053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:07.904531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 215/443] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 00:17:07.904531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:07.959084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217eb03-dc5d-4727-8482-d72596d2a8f0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:07.993237 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:07.993855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:07.994133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:07.994405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:07.998831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d01dfa-610b-4f7e-a0bd-326c773b56f8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.004202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:08.009746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:08.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:08.011455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 229/444] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:08.012112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.035138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.035993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.036269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.036575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.037695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.039169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.040820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 216/445] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:07 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.041566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.075072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.099345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.113102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ffa3e-f372-40f4-bcba-a335bda384d0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.144006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05bb92-459b-4aa9-b7e9-91075860fac0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.147194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e5608-8db4-449f-a924-1680e476392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.147964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e5608-8db4-449f-a924-1680e476392f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.148241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e5608-8db4-449f-a924-1680e476392f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.148540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e5608-8db4-449f-a924-1680e476392f None admin] PATH_INFO: `/v3/projects/00e0be78705643f38f372c4bbaf2a54a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.149648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e5608-8db4-449f-a924-1680e476392f None admin] RBAC: Authorizing `identity:get_project(project_id=00e0be78705643f38f372c4bbaf2a54a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.151118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e5608-8db4-449f-a924-1680e476392f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.152747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 230/446] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/projects/00e0be78705643f38f372c4bbaf2a54a => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.153502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e5608-8db4-449f-a924-1680e476392f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.182191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.182799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.183077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.183354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.184006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:08.184312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.185743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.194004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 217/447] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.195341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.254184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e5608-8db4-449f-a924-1680e476392f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.281834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.287805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.288493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.288810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.289082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.290195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.291645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.293175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfcd4-7d4a-4b8e-8040-521180782c16 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.293273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 231/448] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.293979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.313097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.330591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.331217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.331489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.331754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] PATH_INFO: `/v3/groups/d1f79097b32c446eba869f5a63f23a64` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.332872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] RBAC: Authorizing `identity:get_group(group_id=d1f79097b32c446eba869f5a63f23a64)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.334298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.335878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 218/449] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/groups/d1f79097b32c446eba869f5a63f23a64 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.336652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.396131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e309e-e0c6-46d5-b5f1-c86b855bb1c0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.429674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.430187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.430472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.430738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.435870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9110-0722-4d24-a057-fd85435388b1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.468961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.469546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.469825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.470087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.470790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=42931b58092d490eb3e62614a2778775, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:08.471088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.472516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.478927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 219/450] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=42931b58092d490eb3e62614a2778775 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.479783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.506331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.513581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.515088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.539466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.596126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164784-afc9-42db-8bed-609b2b7c0775 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.633087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 232/451] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:08.635496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.636103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.636407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.636677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.637515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] RBAC: Adding query filter params (group.id=d1f79097b32c446eba869f5a63f23a64, role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=00e0be78705643f38f372c4bbaf2a54a) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:08.637798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.638932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.639242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.647116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 220/452] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/role_assignments?group.id=d1f79097b32c446eba869f5a63f23a64&scope.project.id=00e0be78705643f38f372c4bbaf2a54a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.756152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.759446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da5d6f-7455-48b9-9623-fb3ccd861b25 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.796931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.797494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.797759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.798025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] PATH_INFO: `/v3/projects/3e0261df5d904c07b66cfae0c5073d2f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.799142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] RBAC: Authorizing `identity:get_project(project_id=3e0261df5d904c07b66cfae0c5073d2f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.800682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.802291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 233/453] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/projects/3e0261df5d904c07b66cfae0c5073d2f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.808468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:08.912480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9903534-2432-4bb4-ac3a-ada2a87bd5a2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:08.924926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:08.946237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3d24-4ee0-43f3-9e16-591aa8d9cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:08.946852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3d24-4ee0-43f3-9e16-591aa8d9cfe0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:08.947127 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3d24-4ee0-43f3-9e16-591aa8d9cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:08.947396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3d24-4ee0-43f3-9e16-591aa8d9cfe0 None admin] PATH_INFO: `/v3/groups/47be00d1d674483fb1f37770be0de959` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:08.948490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3d24-4ee0-43f3-9e16-591aa8d9cfe0 None admin] RBAC: Authorizing `identity:get_group(group_id=47be00d1d674483fb1f37770be0de959)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:08.949932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3d24-4ee0-43f3-9e16-591aa8d9cfe0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:08.951462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 221/454] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/groups/47be00d1d674483fb1f37770be0de959 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:08.957302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:09.053049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311d001-0ae2-44e4-be6c-8772a8cd0a27 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:09.086072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58476b6-9626-4093-9561-299cdf65d273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:09.086656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58476b6-9626-4093-9561-299cdf65d273 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:09.086931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58476b6-9626-4093-9561-299cdf65d273 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:09.087200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58476b6-9626-4093-9561-299cdf65d273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:09.087921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58476b6-9626-4093-9561-299cdf65d273 None admin] RBAC: Adding query filter params (group.id=47be00d1d674483fb1f37770be0de959, role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=3e0261df5d904c07b66cfae0c5073d2f) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:09.088226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58476b6-9626-4093-9561-299cdf65d273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:09.089676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58476b6-9626-4093-9561-299cdf65d273 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:09.095192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 234/455] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Sep 1 00:17:08 2022] GET /identity/v3/role_assignments?group.id=47be00d1d674483fb1f37770be0de959&scope.project.id=3e0261df5d904c07b66cfae0c5073d2f&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:11.584855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8fda-2a27-4370-a11d-56dfdd0b60a2 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:11.585875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8fda-2a27-4370-a11d-56dfdd0b60a2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:11.585981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8fda-2a27-4370-a11d-56dfdd0b60a2 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:11.587521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 222/456] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:11.592355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a9a9-2dc9-441c-996c-686cdbfb3f00 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:11.593213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a9a9-2dc9-441c-996c-686cdbfb3f00 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:11.593714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a9a9-2dc9-441c-996c-686cdbfb3f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:11.616488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d044a9a9-2dc9-441c-996c-686cdbfb3f00 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:11.618003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d044a9a9-2dc9-441c-996c-686cdbfb3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:11.651943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:11.702948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 235/457] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:11.742078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dae924-f7b5-4622-bbfc-8f4dc09deaf8 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:11.742715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dae924-f7b5-4622-bbfc-8f4dc09deaf8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:11.743209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dae924-f7b5-4622-bbfc-8f4dc09deaf8 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:11.744840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 223/458] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:11.750273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e309-7125-4ff6-950d-8d93c983c379 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:11.750831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e309-7125-4ff6-950d-8d93c983c379 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:11.751320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e309-7125-4ff6-950d-8d93c983c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:11.777262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f286e309-7125-4ff6-950d-8d93c983c379 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:11.778756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f286e309-7125-4ff6-950d-8d93c983c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:11.862634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 236/459] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:11.968714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158496d1-63f2-4587-ba2b-088ca0adec9b None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:11.969352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158496d1-63f2-4587-ba2b-088ca0adec9b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:11.969847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158496d1-63f2-4587-ba2b-088ca0adec9b None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:11.971377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 224/460] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:11.976801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d33af7-a9a2-443e-8bb1-69773c2d830b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:11.977093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d33af7-a9a2-443e-8bb1-69773c2d830b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:11.977368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d33af7-a9a2-443e-8bb1-69773c2d830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:11.989648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158496d1-63f2-4587-ba2b-088ca0adec9b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.008400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e4d33af7-a9a2-443e-8bb1-69773c2d830b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:12.009598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e4d33af7-a9a2-443e-8bb1-69773c2d830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:12.143090 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158496d1-63f2-4587-ba2b-088ca0adec9b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:12.146737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 237/461] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:12.178462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:12.179196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.179476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.179748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.191440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:12.192952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:12.207667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d33af7-a9a2-443e-8bb1-69773c2d830b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:12.208087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:12.209021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:12.210002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:12.210002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:12.210002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:12.210002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 225/462] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:12.215658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.248868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:12.278981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:12.363930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d33af7-a9a2-443e-8bb1-69773c2d830b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:12.369949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d8c12-4a4b-460d-99c9-ba2f3ab92aca None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:12.405715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685c1b6-fbb2-407b-b20b-d8ca05acaff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:12.406248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c1b6-fbb2-407b-b20b-d8ca05acaff0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.406614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c1b6-fbb2-407b-b20b-d8ca05acaff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.406884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685c1b6-fbb2-407b-b20b-d8ca05acaff0 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.407512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685c1b6-fbb2-407b-b20b-d8ca05acaff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:12.407810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685c1b6-fbb2-407b-b20b-d8ca05acaff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:12.409303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685c1b6-fbb2-407b-b20b-d8ca05acaff0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:12.412109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5445d-9032-4f9f-98f1-656fc6181fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:12.413492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5445d-9032-4f9f-98f1-656fc6181fa7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.413920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5445d-9032-4f9f-98f1-656fc6181fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.414368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5445d-9032-4f9f-98f1-656fc6181fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.426196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5445d-9032-4f9f-98f1-656fc6181fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:12.427067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 226/463] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:12.428115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5445d-9032-4f9f-98f1-656fc6181fa7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:12.428435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27982f53-9d84-4dd4-b08e-e1ed222ee4a2 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.428905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27982f53-9d84-4dd4-b08e-e1ed222ee4a2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.429156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27982f53-9d84-4dd4-b08e-e1ed222ee4a2 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.434598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 227/464] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:12.434598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27982f53-9d84-4dd4-b08e-e1ed222ee4a2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-68b5445d-9032-4f9f-98f1-656fc6181fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:12.455123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:12.456370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:12.457485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:12.457485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:12.457485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:12.460084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 238/465] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:12.462161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22fec3-8ff6-49b4-af18-3e1f3b95d105 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.462757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22fec3-8ff6-49b4-af18-3e1f3b95d105 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.463292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22fec3-8ff6-49b4-af18-3e1f3b95d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.484208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fb22fec3-8ff6-49b4-af18-3e1f3b95d105 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:12.485489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fb22fec3-8ff6-49b4-af18-3e1f3b95d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:12.540620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:12.550868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27982f53-9d84-4dd4-b08e-e1ed222ee4a2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:12.559970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 239/466] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:12.569684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22fec3-8ff6-49b4-af18-3e1f3b95d105 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.572831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:12.587898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:12.588536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.588744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.589017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.589665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:12.591154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:12.628411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 228/467] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:17:12 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:12.628411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.755421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22fec3-8ff6-49b4-af18-3e1f3b95d105 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:12.793738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:12.794758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.795246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.795719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.796598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:12.797111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:12.798861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:12.813030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 240/468] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:12.818541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.822430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b7ce4-002c-4e89-90ae-f447ad1c5ecb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:12.868858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:12.869494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:12.869772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:12.870044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:12.884440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:12.885948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:12.896444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:12.901387 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:12.906617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:12.907593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:12.908531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:12.908531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:12.908531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:12.910302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 229/469] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:12.911392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:12.962260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e6a61-e7bc-41b4-bb5f-60c883aa19d2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:13.005848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:13.007325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.007891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.008174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.008920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:13.011226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:13.031468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e0ab3-64a8-491a-ade7-6cda1cd8596d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:13.043765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 241/470] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:17:12 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:13.045535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:13.075876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:13.076641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.077441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.077718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.090847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:13.092639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:13.111880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:13.112979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:13.113829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:13.113829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:13.113829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:13.113829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 230/471] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:13.119977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:13.182461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:13.198403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfbb0-43a7-4469-ae3b-038caaae9ed3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:13.222957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:13.246023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4ac19-081a-4a4c-91c0-2ad621d28731 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:13.247046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0138c9-1f3c-42a1-a6f2-8d4c4c8acaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:13.247736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0138c9-1f3c-42a1-a6f2-8d4c4c8acaea None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.248088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0138c9-1f3c-42a1-a6f2-8d4c4c8acaea None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.248496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0138c9-1f3c-42a1-a6f2-8d4c4c8acaea None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.249199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0138c9-1f3c-42a1-a6f2-8d4c4c8acaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:13.249565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0138c9-1f3c-42a1-a6f2-8d4c4c8acaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:13.251142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0138c9-1f3c-42a1-a6f2-8d4c4c8acaea None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:13.266303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 242/472] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:13.267756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa21a41-7d00-41c6-8def-1a06d81c12de None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.268044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa21a41-7d00-41c6-8def-1a06d81c12de None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.268320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa21a41-7d00-41c6-8def-1a06d81c12de None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.269961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 243/473] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:17:13.278491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee2a7-6b7b-43eb-a5df-e2cb1bfe21fb None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.278781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee2a7-6b7b-43eb-a5df-e2cb1bfe21fb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.279051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee2a7-6b7b-43eb-a5df-e2cb1bfe21fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.299206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-82fee2a7-6b7b-43eb-a5df-e2cb1bfe21fb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:13.300542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-82fee2a7-6b7b-43eb-a5df-e2cb1bfe21fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:13.301442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:13.302114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.302398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.302669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.303309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:13.304138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:13.305543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:13.319613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 231/474] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:13.320591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:13.389601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 244/475] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:17:13.391278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fee2a7-6b7b-43eb-a5df-e2cb1bfe21fb None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:13.445691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7355-9473-4ab1-b1cd-d88e1fd79544 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:13.466625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:13.504209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:13.505261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.505538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.505808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.506454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:13.511586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:13.545051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fee2a7-6b7b-43eb-a5df-e2cb1bfe21fb None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:13.554178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 232/476] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:17:13 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:13.568150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:13.619941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:13.620608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.620892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.621167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.621836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:13.623326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:13.659277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 245/477] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:17:13 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:13.813006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:13.931608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99eff1-7993-440a-837d-79652a7e4c26 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:13.967553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:13.968158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:13.968449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:13.968716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:13.969381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:13.970745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:13.979200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.sql.core [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 00:17:13.979200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 00:17:13.979200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [parameters: {'id': 'eec4ffdb3ac34185b8a9ad81419f886d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 00:17:13.979200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application conn.query(q) Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result.read() Sep 01 00:17:13.996409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 00:17:13.997331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application next(self.gen) Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application yield resource Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application next(self.gen) Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise self.value Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application session.commit() Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 00:17:13.998694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.session.flush() Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application compat.raise_( Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 00:17:13.999833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 00:17:14.000760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application conn.query(q) Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result.read() Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 00:17:14.001579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [parameters: {'id': 'eec4ffdb3ac34185b8a9ad81419f886d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:14.002372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 00:17:14.004924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:14.007082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 233/478] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Sep 1 00:17:13 2022] POST /identity/v3/roles => generated 144 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:14.007236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:14.113512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c06b-b5a3-4257-909c-e79d52919df8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:14.160964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f695ea-7109-4fc8-8f06-fdfdda33b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:14.161170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f695ea-7109-4fc8-8f06-fdfdda33b668 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:14.161424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f695ea-7109-4fc8-8f06-fdfdda33b668 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:14.161625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f695ea-7109-4fc8-8f06-fdfdda33b668 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:14.177110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f695ea-7109-4fc8-8f06-fdfdda33b668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-86f695ea-7109-4fc8-8f06-fdfdda33b668 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:14.182600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:14.183486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:14.184719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 246/479] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:14.189749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:14.223724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:14.295926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed52c82-981c-4078-941f-8411c558f65f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:14.334813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe822c-d94d-4803-96da-cae5c50d9c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:14.335417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe822c-d94d-4803-96da-cae5c50d9c41 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:14.335691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe822c-d94d-4803-96da-cae5c50d9c41 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:14.336010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe822c-d94d-4803-96da-cae5c50d9c41 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:14.336697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe822c-d94d-4803-96da-cae5c50d9c41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:14.337043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe822c-d94d-4803-96da-cae5c50d9c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:14.338419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe822c-d94d-4803-96da-cae5c50d9c41 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:14.346829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 234/480] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:14.946092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c5f03-2417-4423-a6ba-d385f6735eb4 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:14.946416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c5f03-2417-4423-a6ba-d385f6735eb4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:14.946637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c5f03-2417-4423-a6ba-d385f6735eb4 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:14.948255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 247/481] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:14.953360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ccde6-4740-4977-810a-5302769f271c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:14.953906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ccde6-4740-4977-810a-5302769f271c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:14.953906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ccde6-4740-4977-810a-5302769f271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:14.978329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1a6ccde6-4740-4977-810a-5302769f271c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:14.979836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1a6ccde6-4740-4977-810a-5302769f271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:15.067409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 235/482] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:15.369079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c5f03-2417-4423-a6ba-d385f6735eb4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:15.399179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:15.501983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c5f03-2417-4423-a6ba-d385f6735eb4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:15.546167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050b5eb-a57c-43e9-8c22-f568effc1387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:15.546800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b5eb-a57c-43e9-8c22-f568effc1387 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:15.547077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b5eb-a57c-43e9-8c22-f568effc1387 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:15.547343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b5eb-a57c-43e9-8c22-f568effc1387 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:15.566614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050b5eb-a57c-43e9-8c22-f568effc1387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-e050b5eb-a57c-43e9-8c22-f568effc1387 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:15.571626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:15.572615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:15.573992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 248/483] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:15.578463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ccde6-4740-4977-810a-5302769f271c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:15.607888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:15.682904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161ae70-85ac-471b-9abc-29cab7f1266a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:15.683194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161ae70-85ac-471b-9abc-29cab7f1266a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:15.683368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161ae70-85ac-471b-9abc-29cab7f1266a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:15.684946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 249/484] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:17:15.690902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd573aed-28ed-4835-a148-e8b74f71b70c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:15.691245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd573aed-28ed-4835-a148-e8b74f71b70c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:15.691521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd573aed-28ed-4835-a148-e8b74f71b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:15.718787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ccde6-4740-4977-810a-5302769f271c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:15.721856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-bd573aed-28ed-4835-a148-e8b74f71b70c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:15.723086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bd573aed-28ed-4835-a148-e8b74f71b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:15.775140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:15.776091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:15.776612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:15.777112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:15.777952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:15.778456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:15.780002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:15.789397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 236/485] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:15.794681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:15.827300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 250/486] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:15.915868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:15.934475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1382fb-f969-47d1-b368-f64e3c773d9c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:15.985330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ec1fb-acf2-4ffd-8b73-7c2b90e7f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:15.986079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ec1fb-acf2-4ffd-8b73-7c2b90e7f22b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:15.986274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ec1fb-acf2-4ffd-8b73-7c2b90e7f22b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:15.986527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ec1fb-acf2-4ffd-8b73-7c2b90e7f22b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.000589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ec1fb-acf2-4ffd-8b73-7c2b90e7f22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:16.002044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ec1fb-acf2-4ffd-8b73-7c2b90e7f22b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-4a7ec1fb-acf2-4ffd-8b73-7c2b90e7f22b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:16.019246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:16.020201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:16.021091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:16.021091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:16.021091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:16.021091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 237/487] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:16.026159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd573aed-28ed-4835-a148-e8b74f71b70c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.045498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:16.150897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd573aed-28ed-4835-a148-e8b74f71b70c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.180417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b4aa-1d37-4643-bb7c-85cee6da9ae0 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.180417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b4aa-1d37-4643-bb7c-85cee6da9ae0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.180417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b4aa-1d37-4643-bb7c-85cee6da9ae0 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.180417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 238/488] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:16.191867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.192512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.192794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.193065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.193707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:16.194008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:16.195922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:16.197150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59df86-64ec-434f-ab69-7e2914e620a0 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.197641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59df86-64ec-434f-ab69-7e2914e620a0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.198113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59df86-64ec-434f-ab69-7e2914e620a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.208170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 251/489] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:16.212195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.224064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4b59df86-64ec-434f-ab69-7e2914e620a0 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:16.225649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4b59df86-64ec-434f-ab69-7e2914e620a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:16.291789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:16.304438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 239/490] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:16.304438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59df86-64ec-434f-ab69-7e2914e620a0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.331573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fe107-9530-43c0-aa29-e78d0be8b0fc None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.375126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466c7f9-e6b2-42cb-aaa0-7cfb14871746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.376069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466c7f9-e6b2-42cb-aaa0-7cfb14871746 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.376534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466c7f9-e6b2-42cb-aaa0-7cfb14871746 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.376863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466c7f9-e6b2-42cb-aaa0-7cfb14871746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.387770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:16.393212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466c7f9-e6b2-42cb-aaa0-7cfb14871746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c466c7f9-e6b2-42cb-aaa0-7cfb14871746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:16.400033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:16.401036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:16.401848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:16.404519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 252/491] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:16.406032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7210a-a25c-4941-b75d-105b5ecbbbda None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.407815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7210a-a25c-4941-b75d-105b5ecbbbda None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.409022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7210a-a25c-4941-b75d-105b5ecbbbda None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.410383 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 253/492] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:16.411447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7210a-a25c-4941-b75d-105b5ecbbbda None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.433019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59df86-64ec-434f-ab69-7e2914e620a0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.475928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab5640-b07c-4cab-a883-d470f4dd1e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.476582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab5640-b07c-4cab-a883-d470f4dd1e2c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.476928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab5640-b07c-4cab-a883-d470f4dd1e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.477282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab5640-b07c-4cab-a883-d470f4dd1e2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.487040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab5640-b07c-4cab-a883-d470f4dd1e2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:16.488757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab5640-b07c-4cab-a883-d470f4dd1e2c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-cfab5640-b07c-4cab-a883-d470f4dd1e2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:16.505394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:16.506364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:16.507343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:16.516697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 240/493] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:16.518038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548d13-2b1a-46b9-8f37-5b943e2848f4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.518318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548d13-2b1a-46b9-8f37-5b943e2848f4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.518571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548d13-2b1a-46b9-8f37-5b943e2848f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.538183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7210a-a25c-4941-b75d-105b5ecbbbda None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.542625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-65548d13-2b1a-46b9-8f37-5b943e2848f4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:16.543803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-65548d13-2b1a-46b9-8f37-5b943e2848f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:16.576500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.577668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.578153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.578629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.579564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:16.580066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:16.581773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:16.583539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:16.593673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 254/494] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:16.594880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.618600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 241/495] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:16.619888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65548d13-2b1a-46b9-8f37-5b943e2848f4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.700848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:16.719174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1da95c-68fe-4d2e-ace9-6fdd755f9ceb None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.751774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65548d13-2b1a-46b9-8f37-5b943e2848f4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.761827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29280-073d-451e-91af-7b464d71242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.762556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29280-073d-451e-91af-7b464d71242a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.762941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29280-073d-451e-91af-7b464d71242a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.763337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29280-073d-451e-91af-7b464d71242a None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.764566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29280-073d-451e-91af-7b464d71242a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:16.764981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29280-073d-451e-91af-7b464d71242a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:16.767110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29280-073d-451e-91af-7b464d71242a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:16.798395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.799169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.799547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.799921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.809751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 255/496] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:16.810825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29280-073d-451e-91af-7b464d71242a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.811440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:16.816901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:16.817976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:16.818783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:16.819971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 242/497] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:16.824981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:16.876213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:16.922318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29280-073d-451e-91af-7b464d71242a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.937404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba159e-a422-415e-bf75-f09ed0ddbdc3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:16.957027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:16.958290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.958920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.959230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.959520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.972040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:16.973562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:16.980949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3524f-dc52-4ef4-8f5d-bc5649f4a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:16.981553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3524f-dc52-4ef4-8f5d-bc5649f4a19c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:16.981833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3524f-dc52-4ef4-8f5d-bc5649f4a19c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:16.982112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3524f-dc52-4ef4-8f5d-bc5649f4a19c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:16.988348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:16.989447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:16.990329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:16.990329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:16.990329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:16.990329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 256/498] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:16.990557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.049828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3524f-dc52-4ef4-8f5d-bc5649f4a19c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.051204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3524f-dc52-4ef4-8f5d-bc5649f4a19c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.090515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd6d71-3ff1-41a4-8f2f-13d7062b1aef None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.097195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.124459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.125057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.125336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.125608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.126263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:17.126564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.128007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.136305 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 257/499] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:17.137320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.156528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 243/500] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:17.156528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb4d9-5fc1-44f6-8f9d-d2f9384de176 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.156528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb4d9-5fc1-44f6-8f9d-d2f9384de176 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.156528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb4d9-5fc1-44f6-8f9d-d2f9384de176 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.156528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 244/501] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:17.156935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb4d9-5fc1-44f6-8f9d-d2f9384de176 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.175410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.237001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4311e-6f4d-4cda-b098-2beba6daf6b4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.256047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb4d9-5fc1-44f6-8f9d-d2f9384de176 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.269695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.270317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.270599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.270943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.281603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:17.286825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:17.287770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:17.289304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:17.289915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.290146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.290407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.290670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.291324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:17.291618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.293013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.293357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 258/502] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:17.294181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.304361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 245/503] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:17.304974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.323373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.381015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.395213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090478de-2791-4273-b537-a6eeab0c3561 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.403147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474596fc-d6d6-405d-a912-47f25a46c648 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.428302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9815b-7fec-41c1-8f8b-fa6b586785cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.429019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9815b-7fec-41c1-8f8b-fa6b586785cd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.429338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9815b-7fec-41c1-8f8b-fa6b586785cd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.429614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9815b-7fec-41c1-8f8b-fa6b586785cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.436167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.436838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.437074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.437338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.439901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9815b-7fec-41c1-8f8b-fa6b586785cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.441401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9815b-7fec-41c1-8f8b-fa6b586785cd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.448895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.450317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-43b9815b-7fec-41c1-8f8b-fa6b586785cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:17.455639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:17.456589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:17.457460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:17.457460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:17.457460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:17.457460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 259/504] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:17.458294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb03d-1b33-4ce8-a043-f3cb95834c39 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.458578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb03d-1b33-4ce8-a043-f3cb95834c39 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.458849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb03d-1b33-4ce8-a043-f3cb95834c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:17.468018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:17.469436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:17.470768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:17.470768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:17.470768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:17.470768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 246/505] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:17.470768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.477260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fdbfb03d-1b33-4ce8-a043-f3cb95834c39 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:17.478440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fdbfb03d-1b33-4ce8-a043-f3cb95834c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:17.549506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 260/506] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:17.550403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb03d-1b33-4ce8-a043-f3cb95834c39 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.566828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.583356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882449f-a324-40af-ad45-5fe6903ae561 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.615270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.622287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.622886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.623460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.624295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:17.624621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.626486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.634927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 247/507] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:17.635717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.670860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb03d-1b33-4ce8-a043-f3cb95834c39 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.710375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.711448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.711775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.712045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.721334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.722801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.735443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ff88-0225-4d1a-8150-718c99d6bff8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:17.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:17.737759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 261/508] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:17.738646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.777051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.777651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.777923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.778186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.778813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:17.779106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.780597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.791970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 248/509] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:17.792795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.818219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.849458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:17.849617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db6220-08cb-42a2-b708-458e438a7514 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.883768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.884368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.884670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.884935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.885561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:17.885856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.887218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.896160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90589-be32-4ebb-b0b3-32007a78d1d8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:17.899018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 262/510] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:17.899797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:17.930101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:17.930739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:17.931009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:17.931274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:17.940988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:17.942423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:17.956693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:17.957618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:17.958488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:17.958488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:17.958488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:17.958488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 249/511] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:17.958708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.003606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839453c0-f96a-4a03-aebf-c0562c42e82b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.031556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.038078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.038674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.038956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.039221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.039933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:18.040233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.041689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.057660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b832cd0-7115-4742-8b9b-a6ff6d866355 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.058494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 263/512] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:18.059288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.060000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.093573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.094119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.094388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.094651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.102536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.104245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:18.115035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:18.115933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 250/513] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:18.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.161525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4eda3-8f25-47d4-9ac2-ef54d42a281e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.195436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.196153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.196528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.196873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.206645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.208111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.214640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6fd37-40cb-4d42-b8ab-14d804c122ee None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:18.222753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:18.223729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:18.224857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:18.224857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:18.224857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:18.224857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 264/514] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:18.224857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.248729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.249358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.249629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.249897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.256986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.258442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.266423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:18.270270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:18.271167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 251/515] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:18.272263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.297387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.328406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534f69e-8689-43d1-bac3-9a5a31a3b18b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.361976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.362512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.362789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.363057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.363684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:18.363982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.365410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.371249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31605919-f907-4529-ad73-3076d2c97d10 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.378397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 265/516] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:18.379190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.403751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.404352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.404654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.404923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.472208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.473688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.474321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.478006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd850-d0ca-45f3-9367-0ad4e46a174a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.497672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.514011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.514725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.515010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.515282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.516015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:18.516320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.517794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.535687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 266/517] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:18.536520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.572635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 252/518] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:18.573465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.636729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bac7f-6980-42f1-923b-aecc8b7485d5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.669776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.670206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f809ef-42da-4fb3-b50e-b0ffbd39376a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.670370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.670646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.670915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.671539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:18.671835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.673241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.684813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 267/519] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:18.685585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.693510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.704631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.705372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.706152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.706430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.706720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.707399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:18.707712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.709157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.726746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 253/520] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:18.727532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.790632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beae18-7195-4624-9188-eeebcb71a059 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.823121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.823736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.824011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.824278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.825560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d564854-3370-439c-9d16-7d1c34104e71 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.831369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.832862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:18.843694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:18.844819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 00:17:18.845919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:18.849551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 268/521] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:18.850892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:18.860821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.861421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.861696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.861967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.913249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.926765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:18.929379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.930839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:18.949040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7826e7c-600f-46f8-90f5-95b053dd7a54 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:18.981658 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:18.982261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:18.982538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:18.982804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:18.992751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:18.994188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:19.008626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:19.009754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:19.010773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:19.010773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:19.010773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:19.010773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 269/522] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:19.010773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.035658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 254/523] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:19.036604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.115444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a04e6-d5c5-4a1f-a1ec-bd352c917981 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.119379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.136086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73810f38-f423-43ef-a255-581ac9ee0019 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.143698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.150172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.150776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.151050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.151319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.151959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.153414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.170738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.171265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.171537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.171802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.172543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:19.172844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.173333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 270/524] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:17:19 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:19.174132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.174262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.180006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 255/525] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/role_assignments?user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:19.180893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.329569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622367f-fa81-4532-85de-45188f4d586b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.334076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b630b97-ae0e-4453-960c-e2fbe8169c0c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.384561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.385177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.385457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.385587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.385729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.386383 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:19.386633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.386755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.387152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.387563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.388056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.388677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:19.389140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.390717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.405362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 256/526] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:19.406227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.414436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 271/527] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:19.415482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.420425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.472578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.534112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3646-e446-42f4-a13a-e12fc9522d30 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.534885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f567a-ff4f-486b-9bc0-8a45f618ba2c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.571828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.572673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.573053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.573443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.579495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.580293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.580704 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.580972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.581336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.582901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.593262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.594725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:19.596520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:19.597546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:19.599226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:19.600311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 272/528] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:19.600906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:19.612158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:19.614215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:19.616316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:19.616316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:19.616316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:19.616316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 257/529] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:19.616316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.697450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.718579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277348d3-6e2b-4cb1-a24e-cc73a6567d96 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.744873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a8bf-be57-4872-aa3b-9d3cb0138cd8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.764550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.765904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.766350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.767026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.785797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.786869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.787287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.788405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.789522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:19.789967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.791559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.796832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.808508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 258/530] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:19.809573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.841949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.843649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.932861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c799-c721-43a8-b804-c91c90bdb40b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:19.954052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.963197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 273/531] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:19.964147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:19.972719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:19.975420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:19.976246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:19.976738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:19.977201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:19.978049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:19.978819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:19.980409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:19.993646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 259/532] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:19.994781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:20.070054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4de8d3-85e5-4c24-a456-3b9b14878b3d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:20.099681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507572e0-a3f4-4dc2-a617-384be42e02ef None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:20.106773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:20.107515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:20.107862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:20.108186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:20.108988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=fae893320e6c4ab996cdc2230172417e) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:20.109296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:20.110775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:20.117109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 274/533] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/role_assignments?user.id=fae893320e6c4ab996cdc2230172417e&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:20.117991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:20.139435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:20.140801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:20.141276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:20.141741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:20.154252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:20.156081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:20.171323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:20.172509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:20.173569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:20.173569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:20.173569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:20.175292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 260/534] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:20.185755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:20.213254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:20.232282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:20.289283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988dc6-6bcf-48fe-842d-dfe62ffd557f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:20.330761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:20.331316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:20.331597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:20.331870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:20.339287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:20.340788 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:20.353425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:20.354573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:20.355425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 275/535] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:20.370832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:20.390385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fee91-0bee-4134-a85a-2146b235379b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:20.438188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:20.439132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:20.439629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:20.440122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:20.440972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:20.441465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:20.443048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:20.455686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 261/536] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:20.465332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:20.532419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7027-21ec-4380-8298-564cccd88272 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:20.557241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:20.571771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:20.572408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:20.572888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:20.573183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:20.573865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:20.574173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:20.575644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:20.614467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 276/537] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:20.621443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:20.640193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:20.657611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ab830-c1e0-4293-af01-6524e05beba2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:20.731166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:20.732222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:20.733442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:20.733919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:20.745225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:20.747756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:20.774381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:20.775400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:20.776260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:20.780233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 262/538] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:20.786843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:20.819591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ea5e4-f7de-48e9-a1b2-f7947160999f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:20.863485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:20.864764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:20.865296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:20.865779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:20.867252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=b5a31dd48b6b4377a0eb375502344dcf) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:20.867764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:20.869455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:20.876317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 277/539] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:20 2022] GET /identity/v3/role_assignments?user.id=b5a31dd48b6b4377a0eb375502344dcf&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:20.992856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad5b63-6251-44bd-bdd4-41ab80000ce3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:21.039965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8775f6-22bd-48b6-861b-5fcd57466ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:21.040603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8775f6-22bd-48b6-861b-5fcd57466ae7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:21.040891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8775f6-22bd-48b6-861b-5fcd57466ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:21.041147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8775f6-22bd-48b6-861b-5fcd57466ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:21.041852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8775f6-22bd-48b6-861b-5fcd57466ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:21.042140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8775f6-22bd-48b6-861b-5fcd57466ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:21.044771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8775f6-22bd-48b6-861b-5fcd57466ae7 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:21.057934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 263/540] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:21.063571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:21.122087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:21.184443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c38b7-a9bd-4aa5-86be-0ac1b15f5681 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:21.225670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecacf93-235c-4389-8ebe-fefa7f4fa811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:21.226341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecacf93-235c-4389-8ebe-fefa7f4fa811 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:21.226624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecacf93-235c-4389-8ebe-fefa7f4fa811 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:21.226899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecacf93-235c-4389-8ebe-fefa7f4fa811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:21.227691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecacf93-235c-4389-8ebe-fefa7f4fa811 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=baa7f3487b674e75afe5fca74db44807) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:21.228000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecacf93-235c-4389-8ebe-fefa7f4fa811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:21.229768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecacf93-235c-4389-8ebe-fefa7f4fa811 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:21.236566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 278/541] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:21 2022] GET /identity/v3/role_assignments?user.id=baa7f3487b674e75afe5fca74db44807&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:21.331545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9e23-096d-4aff-8f37-f1cef193bd49 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:21.332096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9e23-096d-4aff-8f37-f1cef193bd49 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:21.332096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9e23-096d-4aff-8f37-f1cef193bd49 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:21.333865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 264/542] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:21.339317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b52b-e74f-46c5-b7a7-89d8b0dd52fd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:21.339608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b52b-e74f-46c5-b7a7-89d8b0dd52fd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:21.339886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b52b-e74f-46c5-b7a7-89d8b0dd52fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:21.365690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4ee3b52b-e74f-46c5-b7a7-89d8b0dd52fd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:21.367006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4ee3b52b-e74f-46c5-b7a7-89d8b0dd52fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:21.464441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 279/543] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:21.472286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eee46-c52a-4ad4-8254-65c3fc33a507 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:21.472589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eee46-c52a-4ad4-8254-65c3fc33a507 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:21.472863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eee46-c52a-4ad4-8254-65c3fc33a507 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:21.474380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 265/544] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:21.480004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63bdec-cd84-47e4-b11f-081117c34f4d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:21.480294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63bdec-cd84-47e4-b11f-081117c34f4d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:21.480595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63bdec-cd84-47e4-b11f-081117c34f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:21.511499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ba63bdec-cd84-47e4-b11f-081117c34f4d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:21.511499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ba63bdec-cd84-47e4-b11f-081117c34f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:21.565910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:21.597740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 280/545] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:21.932266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eee46-c52a-4ad4-8254-65c3fc33a507 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:21.948741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63bdec-cd84-47e4-b11f-081117c34f4d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:21.951231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:22.108010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eee46-c52a-4ad4-8254-65c3fc33a507 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.121768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63bdec-cd84-47e4-b11f-081117c34f4d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.160049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.160712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.160992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.161267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.172937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:22.174698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.175561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.176041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.176564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:22.180405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:22.181292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:22.182118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 281/546] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:22.184619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:22.203276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:22.210989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:22.211872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:22.212714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 266/547] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:22.219467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:22.265436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:22.308976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:22.340665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824b191-2ca9-404f-adaa-5cc7c44329e6 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.375084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.375698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.375981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.376259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.376969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:22.377276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:22.379155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:22.387821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 267/548] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:22.392769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:22.433699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da2c4-ffc2-4cb6-9873-e827cac8ec26 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.478057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4b428-1ed3-4c3b-ab8c-09f443e9b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.478952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b428-1ed3-4c3b-ab8c-09f443e9b603 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.479231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b428-1ed3-4c3b-ab8c-09f443e9b603 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.479559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b428-1ed3-4c3b-ab8c-09f443e9b603 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.480232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4b428-1ed3-4c3b-ab8c-09f443e9b603 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:22.480563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4b428-1ed3-4c3b-ab8c-09f443e9b603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:22.482134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4b428-1ed3-4c3b-ab8c-09f443e9b603 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:22.493700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 282/549] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:22.495081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de336a2-caf7-4bd8-bdff-fdb3ffe68d18 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.495664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de336a2-caf7-4bd8-bdff-fdb3ffe68d18 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.495941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de336a2-caf7-4bd8-bdff-fdb3ffe68d18 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.500458 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 283/550] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:22.501639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de336a2-caf7-4bd8-bdff-fdb3ffe68d18 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:22.516078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a080-d912-492a-9b15-1ad5a1c79634 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.555787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcf48b-44a1-459f-9dd1-3cdd5e3280cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.556689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf48b-44a1-459f-9dd1-3cdd5e3280cb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.556810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf48b-44a1-459f-9dd1-3cdd5e3280cb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.557043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf48b-44a1-459f-9dd1-3cdd5e3280cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.559234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:22.569263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcf48b-44a1-459f-9dd1-3cdd5e3280cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:22.571482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcf48b-44a1-459f-9dd1-3cdd5e3280cb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-88fcf48b-44a1-459f-9dd1-3cdd5e3280cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:22.586055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:22.587386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:22.588264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:22.588264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:22.588264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:22.588555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 268/551] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:22.590056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc523cd-cc8b-4a1d-aea8-823e59e52c01 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.590429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc523cd-cc8b-4a1d-aea8-823e59e52c01 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.590788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc523cd-cc8b-4a1d-aea8-823e59e52c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.610723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-afc523cd-cc8b-4a1d-aea8-823e59e52c01 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:22.612113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-afc523cd-cc8b-4a1d-aea8-823e59e52c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:22.626401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de336a2-caf7-4bd8-bdff-fdb3ffe68d18 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.628702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:22.667639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.668567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.668997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.669418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.684454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:22.685645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 269/552] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:22.686430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:22.686663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc523cd-cc8b-4a1d-aea8-823e59e52c01 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:22.706438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:22.707626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:22.708926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:22.708926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:22.708926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:22.710662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 284/553] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:22.717828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:22.854919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc523cd-cc8b-4a1d-aea8-823e59e52c01 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.882329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:22.895699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db826e24-7e84-4d9c-8671-b61bf1256667 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:22.918109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.918712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.918982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.919243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.919877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:22.920168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:22.921586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:22.941045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 270/554] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:22.949695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:22.964399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:22.965011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:22.965284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:22.965549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:22.966189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:22.966540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:22.967917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:22.990197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 285/555] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:22.997174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.016743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.106251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bfc69-c1d8-447d-a8c2-dcd7e8196658 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.135586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3afd-0f20-4a5f-8354-e7ba118b8ff5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.142028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.142654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.142927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.143195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.150935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:23.152393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:23.163502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:23.164466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 271/556] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:23.170771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.185955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7ea9-bc60-43a1-b926-77cb103a549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.186618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7ea9-bc60-43a1-b926-77cb103a549c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.186901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7ea9-bc60-43a1-b926-77cb103a549c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.187178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7ea9-bc60-43a1-b926-77cb103a549c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.195059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7ea9-bc60-43a1-b926-77cb103a549c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:23.196562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7ea9-bc60-43a1-b926-77cb103a549c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:23.205819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-d6ef7ea9-bc60-43a1-b926-77cb103a549c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:23.209058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:23.212330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 286/557] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:17:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab685-1409-4472-b156-16c7902c4070 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.213337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab685-1409-4472-b156-16c7902c4070 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.214043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab685-1409-4472-b156-16c7902c4070 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.218343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 287/558] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:23.219133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ab685-1409-4472-b156-16c7902c4070 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.277636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b982a9-b0bf-4517-ae42-ca0833498917 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.292280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.312282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.312929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.313202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.313469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.324274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:23.326118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ab685-1409-4472-b156-16c7902c4070 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:23.329496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:23.330414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:23.331346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 272/559] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:23.332142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.372887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f4d65-0f31-4139-a2f4-673e22673a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.373427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f4d65-0f31-4139-a2f4-673e22673a15 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.373707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f4d65-0f31-4139-a2f4-673e22673a15 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.373983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f4d65-0f31-4139-a2f4-673e22673a15 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.374817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f4d65-0f31-4139-a2f4-673e22673a15 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:23.375241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f4d65-0f31-4139-a2f4-673e22673a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:23.377464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f4d65-0f31-4139-a2f4-673e22673a15 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:23.401429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 288/560] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:23.401429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6838-e141-47e1-aefc-3123a3456a3a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.401429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6838-e141-47e1-aefc-3123a3456a3a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.401429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6838-e141-47e1-aefc-3123a3456a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.418665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a63f6838-e141-47e1-aefc-3123a3456a3a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:23.419982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a63f6838-e141-47e1-aefc-3123a3456a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:23.453284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.463284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3a48-effe-4a05-9d7a-d8f065237904 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.501875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 289/561] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:23.502976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6838-e141-47e1-aefc-3123a3456a3a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.504879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.505938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.506412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.507835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.508774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:23.509246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:23.510847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:23.569595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 273/562] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:23.569595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.591204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.635092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6838-e141-47e1-aefc-3123a3456a3a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.675758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c58ab-32f8-4fc7-9cc3-ebd509edd236 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.680835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b36895-b27d-4b0d-9ead-33abc488ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.681593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36895-b27d-4b0d-9ead-33abc488ddfe None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.681991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36895-b27d-4b0d-9ead-33abc488ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.684182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36895-b27d-4b0d-9ead-33abc488ddfe None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.684182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b36895-b27d-4b0d-9ead-33abc488ddfe None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:23.684182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b36895-b27d-4b0d-9ead-33abc488ddfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:23.684962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b36895-b27d-4b0d-9ead-33abc488ddfe None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:23.694229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 290/563] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:23.695576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5118f-93ff-40ed-be6c-0af0b7034ba2 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.695962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5118f-93ff-40ed-be6c-0af0b7034ba2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.696335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5118f-93ff-40ed-be6c-0af0b7034ba2 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.697771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 291/564] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:23.702512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5118f-93ff-40ed-be6c-0af0b7034ba2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.718161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7afe-7703-4a05-a237-071ab6f78088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.718985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7afe-7703-4a05-a237-071ab6f78088 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.719423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7afe-7703-4a05-a237-071ab6f78088 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.719692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7afe-7703-4a05-a237-071ab6f78088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.744672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.791110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7afe-7703-4a05-a237-071ab6f78088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:23.792611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7afe-7703-4a05-a237-071ab6f78088 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:23.808121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5118f-93ff-40ed-be6c-0af0b7034ba2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.828313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.842088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:23.842710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.842987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.843262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.853869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:23.855309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:23.870236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:23.871321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:23.872442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:23.872442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:23.872442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:23.872442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 292/565] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:23.872442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:23.894761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 274/566] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:23.895926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1ea9-ff8b-45dd-953f-87325b3a90a5 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:23.896209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1ea9-ff8b-45dd-953f-87325b3a90a5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:23.896510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1ea9-ff8b-45dd-953f-87325b3a90a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:23.914024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f76d1ea9-ff8b-45dd-953f-87325b3a90a5 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:23.915204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f76d1ea9-ff8b-45dd-953f-87325b3a90a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:23.963221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:23.973902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a923e1-8ffb-4f32-96c2-e08ce03e69c7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:23.981801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 275/567] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:23.982612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d1ea9-ff8b-45dd-953f-87325b3a90a5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.008815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.009444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.009714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.009986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.020625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.022730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:24.036908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:24.038687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:24.039760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:24.039760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:24.039760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:24.043093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 293/568] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:24.043858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.068053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.097515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d1ea9-ff8b-45dd-953f-87325b3a90a5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.134168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.134798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.135073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.135412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.145580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:24.146206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb1fea-9970-43d8-acd7-9acbcf6aa503 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:24.150432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:24.156372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 276/569] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:24.157468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.188967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.189781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.190061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.190330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.190967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:24.191270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.192673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.204655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.205949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 294/570] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:24.206806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.265679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1061f-8d53-4243-9569-2629cbdbcafd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.292153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.299228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.299847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.300124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.300424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.308589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53087710-70b4-4f47-9d02-d3db640cff2c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.310650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.312107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:24.326112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:24.327124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:24.328052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:24.328052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:24.328052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:24.328052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 277/571] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:24.328052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.346200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.346807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.347088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.347360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.347993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:24.348294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.349715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.361551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 295/572] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:24.362481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.422376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.428023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0d850-38f2-4b45-8f33-e8b6cbb6622e None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.461060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.461666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.461910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.462182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.462834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:24.462935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bd1df-a5ec-43c1-b1dd-5ac606de89c1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.463132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.464526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.472166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 278/573] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:24.472966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.497158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.497777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.498104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.498373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.504790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.506233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:24.517464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:24.518571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 296/574] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:24.519472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.524440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.581588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e593b-5d88-48fe-a37e-3337b91989b6 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.614672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.615286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.615561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.616364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.619026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c935a2b-e0a3-40c2-ad09-282edc401d6c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.626344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:24.631663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:24.632785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 279/575] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:24.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.653550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.654155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.654436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.654698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.655392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:24.655701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.655831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.657435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.669880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 297/576] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:24.670670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.732104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.737236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1091f-15c7-44ba-a520-496e71c75c27 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.769474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b42e7-2528-4596-a3bf-b1a944db627b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.770375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.770996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.771271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.772721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.779326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.780814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:24.791695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:24.792808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 280/577] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:24.793785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.805490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.806122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.806396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.806665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.816792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.818257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:24.833029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:24.834130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:24.835311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:24.835311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:24.835311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:24.835311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 298/578] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:24.835311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.874476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.896604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0beae-187f-4ad8-bfb2-ea8c1f33e815 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.929043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.929633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.929906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.930180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.930857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:24.931155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.932601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.935811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc823a8-eda6-4823-937a-46e22e90c2b8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:24.944583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 281/579] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:24.945377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:24.951834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:24.969729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:24.970477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:24.970763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:24.971031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:24.971684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:24.971983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:24.973390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:24.981792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 299/580] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:24.982616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.044972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e425970-ceb3-4247-8b63-468b37a8b2f7 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.080072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9cb6d-84c4-417d-9826-a210845f7dfa None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.080259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.080730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.081005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.081274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.088091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.089569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.091329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:25.101929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:25.102982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 282/581] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:25.104339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.117372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.117975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.118252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.118523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.119246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:25.119550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.121009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.137645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 300/582] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Sep 1 00:17:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:25.138408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.171020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.206313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4824bb7-3056-40d8-b017-84a443c5fc57 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.234719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20ab3-5d62-49e2-9403-eac481ff9195 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.239719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.240319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.241163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.241402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.242036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:25.242335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.243713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.255202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 283/583] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:25.255829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.270310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.270969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.271245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.271517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/c63bab6bcfed4cb3b05de6ad4a4b43a4/roles/80e9dd6f85584a769f314f6f052c4cc2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.285341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=c63bab6bcfed4cb3b05de6ad4a4b43a4, role_id=80e9dd6f85584a769f314f6f052c4cc2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.286773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.298790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 301/584] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:25 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/c63bab6bcfed4cb3b05de6ad4a4b43a4/roles/80e9dd6f85584a769f314f6f052c4cc2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:25.312592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.325864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.369595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d9c92-dd11-4c98-aea7-56d39cd3fa4f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.400869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.409000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.410042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.410329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.410655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.420939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba35c3-0f91-47ac-a1f3-604805a9ad12 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.422080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.423626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:25.440550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:25.441789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:25.442781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:25.442781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:25.442781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:25.442781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 284/585] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:25.443537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.469642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.470250 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.470518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.470792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.471479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:25.471783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.473341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.487275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 302/586] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:25.488183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.556475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e7794-72e6-4d8a-b5be-131f3e16ea69 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.567900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.593734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.594357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.594637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.594888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.606717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.607002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece0bf-5b6a-4c16-ad48-c74ec8bd3ded None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.608161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:25.623191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:25.624358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:25.625492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:25.625492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:25.625492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:25.628979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 285/587] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:25.629605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.645687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.646453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.646831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.647253 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.655654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.657298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:25.668982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:25.670213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:17:25.671351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:25.672291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 303/588] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:25.673085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.682647 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.739954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85adf2f-c139-4095-bcaf-3062455f980a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.774406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.775038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.775276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.775545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.776169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:25.776491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.777917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.779319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3f989-6807-442f-9369-e5c895666491 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.793768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 286/589] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:25.793768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.815700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.819594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.820275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.820643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.820983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.821782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=6f2ae343d97d49be9d3d6b430a61a48f) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:25.822151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.823595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.829446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 304/590] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/role_assignments?user.id=6f2ae343d97d49be9d3d6b430a61a48f&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:25.830156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:25.915081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f468-fae2-4789-82a7-f011f253e20d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.937643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:25.955880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:25.956873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:25.957465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:25.957842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:25.958622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:25.959179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:25.961719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:25.978092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabadd0-252d-4bc9-9bc4-53eca6b047ed None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:25.978286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 287/591] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:25.979431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.018179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.019148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.019613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.020142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.020917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:26.021201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.023154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.046519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 305/592] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:26.047397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.085024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:26.110160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab211a53-1d2e-4fbd-8547-761e54027c8a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.157931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.158180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f33716-96ff-4052-97dd-448eeae91fa6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.159062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.159790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.160265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.173687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.175277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:26.187767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:26.188776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 00:17:26.189744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:26.190289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:26.194872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 288/593] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:26.196000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.198618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.199457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.199731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.200000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.207149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.208693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:26.220669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:26.221558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 306/594] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:26.223528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.313922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc836-a17c-47ef-9346-574b037d3cc8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.349663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.350882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.351158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.351429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.363862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.365214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.367259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:26.371820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489809a7-0c8f-4199-b6eb-b31c6150311d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:26.383760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:26.384834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:26.386307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:26.386307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:26.386307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:26.386307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 289/595] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:26.386307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.424520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.425503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.426017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.426490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.427408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:26.428486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.430580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.455107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 307/596] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:26.456255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.510387 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:26.512693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292fc92-f329-45ef-ba45-05d704342fd3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.556122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.556818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.557326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.557326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.558003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:26.558307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.559741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.576038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091e495-42c3-4de7-9438-c819f471e157 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.577753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 290/597] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:26.578613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.622469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.623846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.624502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.625030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.625827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:26.626533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.628694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.637772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:26.646361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 308/598] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:26.648125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.688597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d42f29-4e8f-490b-81b3-fad2637d87ef None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.729659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.730804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.731230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.731652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.746116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.748302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:26.769145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:26.770308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:26.771405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:26.771405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:26.771405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:26.774517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 291/599] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:26.775537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.780720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb80474-7948-4e54-85e4-3a4284569dcc None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.789074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:26.829221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:26.830387 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:26.830814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:26.831256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/fae893320e6c4ab996cdc2230172417e/roles/80e9dd6f85584a769f314f6f052c4cc2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:26.848361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=fae893320e6c4ab996cdc2230172417e, role_id=80e9dd6f85584a769f314f6f052c4cc2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:26.850005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:26.876426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 309/600] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:26 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/fae893320e6c4ab996cdc2230172417e/roles/80e9dd6f85584a769f314f6f052c4cc2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:26.876426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:26.942635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8ab5c-6be7-42ab-8841-fa04fa6a1ad1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:26.964150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:27.007637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.008917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.009468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.009960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.022817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:27.026896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:27.054206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:27.055366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:27.056511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 292/601] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:27.065379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:27.077777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6254-0fcc-4c09-a99a-e7b218861247 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:27.120464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.120908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.121285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.121649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.122385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:27.122801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:27.124268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:27.138573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 310/602] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:27.149235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:27.170607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:27.202118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c0790-436a-436d-9d26-b0fcbc9282eb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:27.241653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd709b-99b4-424e-9cbf-2bbe0adfef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.242851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd709b-99b4-424e-9cbf-2bbe0adfef11 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.243306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd709b-99b4-424e-9cbf-2bbe0adfef11 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.243736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd709b-99b4-424e-9cbf-2bbe0adfef11 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.244726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd709b-99b4-424e-9cbf-2bbe0adfef11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:27.245315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd709b-99b4-424e-9cbf-2bbe0adfef11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:27.247071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd709b-99b4-424e-9cbf-2bbe0adfef11 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:27.262812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 293/603] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:27.264916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97699c-81a5-4671-adfe-db99e606f00d None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.265422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97699c-81a5-4671-adfe-db99e606f00d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.265891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97699c-81a5-4671-adfe-db99e606f00d None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.267293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 294/604] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:27.268806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97699c-81a5-4671-adfe-db99e606f00d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:27.304161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80122768-0142-482c-8ce5-7480e29090e9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:27.324800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:27.344100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15aee7-fadf-48ed-8929-a1670932a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.344804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15aee7-fadf-48ed-8929-a1670932a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.345086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15aee7-fadf-48ed-8929-a1670932a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.345359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15aee7-fadf-48ed-8929-a1670932a2c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.354079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15aee7-fadf-48ed-8929-a1670932a2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:27.355560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15aee7-fadf-48ed-8929-a1670932a2c0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5a15aee7-fadf-48ed-8929-a1670932a2c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:27.367271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:27.368216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:27.369438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 311/605] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:27.370184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994765-9fff-4677-9ad3-b7cea32f0fd2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.370279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994765-9fff-4677-9ad3-b7cea32f0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.370573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994765-9fff-4677-9ad3-b7cea32f0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.389457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-37994765-9fff-4677-9ad3-b7cea32f0fd2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:27.390669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-37994765-9fff-4677-9ad3-b7cea32f0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:27.405152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97699c-81a5-4671-adfe-db99e606f00d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:27.449697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.450902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.451706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.452195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/b5a31dd48b6b4377a0eb375502344dcf/roles/80e9dd6f85584a769f314f6f052c4cc2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.467563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 312/606] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:27.468663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994765-9fff-4677-9ad3-b7cea32f0fd2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:27.469732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=b5a31dd48b6b4377a0eb375502344dcf, role_id=80e9dd6f85584a769f314f6f052c4cc2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:27.471537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:27.484427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:27.493116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 295/607] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:27 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/b5a31dd48b6b4377a0eb375502344dcf/roles/80e9dd6f85584a769f314f6f052c4cc2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:17:27.597110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994765-9fff-4677-9ad3-b7cea32f0fd2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:27.634956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.635646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.635922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.636196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.636992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:27.637302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:27.638779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:27.652475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 313/608] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:27.661564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:27.762701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:27.767289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:27.801338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9fb9-3034-4b3a-b8f7-dd5223c35e16 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:27.851423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af79640-8f37-485c-857d-d32c369774de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.852548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79640-8f37-485c-857d-d32c369774de None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.853106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79640-8f37-485c-857d-d32c369774de None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.853391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79640-8f37-485c-857d-d32c369774de None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/baa7f3487b674e75afe5fca74db44807/roles/80e9dd6f85584a769f314f6f052c4cc2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.855791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:27.876434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af79640-8f37-485c-857d-d32c369774de None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=baa7f3487b674e75afe5fca74db44807, role_id=80e9dd6f85584a769f314f6f052c4cc2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:27.878290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af79640-8f37-485c-857d-d32c369774de None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:27.893544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54519a-b691-4c48-a25a-2a86e4ff0dad None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:27.896527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 296/609] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:27 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/baa7f3487b674e75afe5fca74db44807/roles/80e9dd6f85584a769f314f6f052c4cc2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:27.902404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932384-4e2a-4fc5-9aee-b2dd0cd65195 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.902718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932384-4e2a-4fc5-9aee-b2dd0cd65195 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.903017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932384-4e2a-4fc5-9aee-b2dd0cd65195 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.905114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 297/610] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:27.911356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dbc9e-aeec-42c6-8541-e2fb9a5b3d65 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.911670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dbc9e-aeec-42c6-8541-e2fb9a5b3d65 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.911900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dbc9e-aeec-42c6-8541-e2fb9a5b3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.948008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a63dbc9e-aeec-42c6-8541-e2fb9a5b3d65 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:27.949312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a63dbc9e-aeec-42c6-8541-e2fb9a5b3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:27.964602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:27.965256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:27.965538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:27.965810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:27.982208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:27.987786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:27.988789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:27.989683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 314/611] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:27.995367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.090605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 298/612] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:17:28.143311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881bacb-946a-4dc3-a2a0-87f0566ae137 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:28.170098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:28.180266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:28.181018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:28.181393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:28.181756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:28.182515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:28.182910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:28.184373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:28.193141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 315/613] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:28.198796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dbc9e-aeec-42c6-8541-e2fb9a5b3d65 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.257791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:28.304215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dbc9e-aeec-42c6-8541-e2fb9a5b3d65 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:28.342330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:28.342956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:28.343230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:28.343500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:28.354102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:28.355672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:28.370501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:28.371391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:28.372348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:28.373287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:28.373287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:28.373287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:28.373287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 299/614] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:28.381535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.494536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4527a-4e4d-410b-b110-def7cf1b1ecc None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:28.516289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:28.548209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:28.548843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:28.549114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:28.549380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:28.550014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:28.550309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:28.551918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:28.555371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ba14-31ac-41d6-a925-25a87e86dff6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:28.565310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 300/615] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:28.576758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.596952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:28.597902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:28.598880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:28.599389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:28.612294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:28.618664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:28.619604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:28.620504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:28.627923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 316/616] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:28.629795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.686047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:28.747671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc919e26-197a-4005-a1ac-960b0d12e1f6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:28.794614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:28.796639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:28.797408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:28.799402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:28.800307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:28.800848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:28.804610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:28.827413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 317/617] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:28.829741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.830377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16647dea-71b2-462f-8211-4b24805faa76 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:28.891690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:28.892318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:28.892623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:28.892888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:28.905412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:28.906854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:28.922618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:28.923670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:28.925067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:28.927457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 301/618] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:17:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:28.932583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:28.967698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:29.056178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711d102-968d-466a-9e79-4d2b92ed611a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:29.070475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec533-b537-43a8-b6d1-756a0e7bf590 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:29.088695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:29.098310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:29.100038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.100670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.101142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.102823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:29.103773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:29.107532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:29.139780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 302/619] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:17:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:29.146647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:29.148290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:29.149477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.149959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.150430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.170385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:29.171893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:29.195407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:29.196456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:29.198006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:29.198006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:29.198006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:29.198006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 318/620] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:29.202288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:29.245207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:29.267560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ad2c2-d0f2-4b5e-ab8f-a96f28e454cc None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:29.339050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0298de0-eef1-41cd-9810-b5a0f28d4072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:29.341704 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298de0-eef1-41cd-9810-b5a0f28d4072 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.342211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298de0-eef1-41cd-9810-b5a0f28d4072 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.342709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298de0-eef1-41cd-9810-b5a0f28d4072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.391454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece0b18-f2e7-4351-be54-2d59e441592e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:29.455856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722dea-2180-47d8-8b68-a007b01d9097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:29.456995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722dea-2180-47d8-8b68-a007b01d9097 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.457485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722dea-2180-47d8-8b68-a007b01d9097 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.458471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722dea-2180-47d8-8b68-a007b01d9097 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.459651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722dea-2180-47d8-8b68-a007b01d9097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:29.460191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722dea-2180-47d8-8b68-a007b01d9097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:29.460308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0298de0-eef1-41cd-9810-b5a0f28d4072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:29.461714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0298de0-eef1-41cd-9810-b5a0f28d4072 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:29.462164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722dea-2180-47d8-8b68-a007b01d9097 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:29.477850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 319/621] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:29.480372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fedd9f-bc10-44a6-9cc7-23294c7b903a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.480891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fedd9f-bc10-44a6-9cc7-23294c7b903a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.481366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fedd9f-bc10-44a6-9cc7-23294c7b903a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.483566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 320/622] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:29.484483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fedd9f-bc10-44a6-9cc7-23294c7b903a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:29.514968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:29.563649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:29.587747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 303/623] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:29.589386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb2ad-44d0-4dae-b4ea-22a97d63e6f6 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.589823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb2ad-44d0-4dae-b4ea-22a97d63e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.590264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb2ad-44d0-4dae-b4ea-22a97d63e6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.613558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f39eb2ad-44d0-4dae-b4ea-22a97d63e6f6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:29.615206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f39eb2ad-44d0-4dae-b4ea-22a97d63e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:29.615732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fedd9f-bc10-44a6-9cc7-23294c7b903a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:29.654193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:29.654999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.655386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.655759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] PATH_INFO: `/v3/users/swift` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.665103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:29.667282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:29.683438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:29.684499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 321/624] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:29.685665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:29.700630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 304/625] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:29.701741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb2ad-44d0-4dae-b4ea-22a97d63e6f6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:29.823191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:29.842513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258bddd-d9a5-40ea-93e9-c6cdba1c472a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:29.877582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:29.878546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.879001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.879442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.890268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:29.891968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:29.895613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb2ad-44d0-4dae-b4ea-22a97d63e6f6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:29.907832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:29.908848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:29.909741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:29.909741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:29.909741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:29.911844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 322/626] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:29.918944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:29.926131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:29.947335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b852c-7314-4db2-8299-87d0dcfcaa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:29.948163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b852c-7314-4db2-8299-87d0dcfcaa13 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.948630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b852c-7314-4db2-8299-87d0dcfcaa13 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.949075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b852c-7314-4db2-8299-87d0dcfcaa13 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.949948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b852c-7314-4db2-8299-87d0dcfcaa13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:29.950402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b852c-7314-4db2-8299-87d0dcfcaa13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:29.951969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b852c-7314-4db2-8299-87d0dcfcaa13 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:29.970598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 305/627] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Sep 1 00:17:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:29.972089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4fb6-1045-4d7e-880e-4f7be295d6d8 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:29.972552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4fb6-1045-4d7e-880e-4f7be295d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:29.972970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4fb6-1045-4d7e-880e-4f7be295d6d8 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:29.974550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 306/628] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:29.981528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4fb6-1045-4d7e-880e-4f7be295d6d8 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.043132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bded31a-09db-4601-ac6a-6031debaea6b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.084308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332356-006d-4819-8157-36580271069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.084974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332356-006d-4819-8157-36580271069f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.085219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332356-006d-4819-8157-36580271069f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.085490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332356-006d-4819-8157-36580271069f None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.086170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332356-006d-4819-8157-36580271069f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:30.086470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332356-006d-4819-8157-36580271069f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.087852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332356-006d-4819-8157-36580271069f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.089442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.100851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4fb6-1045-4d7e-880e-4f7be295d6d8 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.102184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 323/629] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:30.103452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26727-0b94-4f8e-94a3-f19936345a43 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.104001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26727-0b94-4f8e-94a3-f19936345a43 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.104890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26727-0b94-4f8e-94a3-f19936345a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.122095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-61d26727-0b94-4f8e-94a3-f19936345a43 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:30.123264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-61d26727-0b94-4f8e-94a3-f19936345a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:30.140479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.141106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.141379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.141894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.152984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.154423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:30.169225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:30.170218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:30.171113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:30.171113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:30.171113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:30.174791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 307/630] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:30.175602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.191887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 324/631] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:30.192751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26727-0b94-4f8e-94a3-f19936345a43 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.203047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.281005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56768-4f42-440b-a21c-3598436433b0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.292654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26727-0b94-4f8e-94a3-f19936345a43 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.315473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.316013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c5f35-cf00-44d2-bacb-045be50143d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.316673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5f35-cf00-44d2-bacb-045be50143d4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.316931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5f35-cf00-44d2-bacb-045be50143d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.317252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5f35-cf00-44d2-bacb-045be50143d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.327927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b1cab-4a52-4327-b6fe-be06c2eeaafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.328579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b1cab-4a52-4327-b6fe-be06c2eeaafe None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.328855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b1cab-4a52-4327-b6fe-be06c2eeaafe None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.329127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b1cab-4a52-4327-b6fe-be06c2eeaafe None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.329291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c5f35-cf00-44d2-bacb-045be50143d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:30.335802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b1cab-4a52-4327-b6fe-be06c2eeaafe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-b64c5f35-cf00-44d2-bacb-045be50143d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:30.336048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:30.337165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:30.338176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:30.338947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b1cab-4a52-4327-b6fe-be06c2eeaafe None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.340739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 308/632] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:30.342143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdb0d-8829-46b1-9067-2f94f4f2f471 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.342413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdb0d-8829-46b1-9067-2f94f4f2f471 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.342677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdb0d-8829-46b1-9067-2f94f4f2f471 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.344035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 309/633] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:30.344611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cdb0d-8829-46b1-9067-2f94f4f2f471 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5a3b1cab-4a52-4327-b6fe-be06c2eeaafe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:30.358518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:30.359430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:30.360363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:30.361186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 325/634] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:30.361729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8c38-74ef-46a9-979c-c5a3ca4fac0c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.362010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8c38-74ef-46a9-979c-c5a3ca4fac0c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.362278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8c38-74ef-46a9-979c-c5a3ca4fac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.380405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2c3e8c38-74ef-46a9-979c-c5a3ca4fac0c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:30.382147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2c3e8c38-74ef-46a9-979c-c5a3ca4fac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:30.439854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.456316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cdb0d-8829-46b1-9067-2f94f4f2f471 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.460725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 326/635] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:30.461557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8c38-74ef-46a9-979c-c5a3ca4fac0c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.492514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.493118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.493397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.493665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.494294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:30.494597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.495982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.512077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 310/636] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:30.512077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.575724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8c38-74ef-46a9-979c-c5a3ca4fac0c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.589726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.612585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.613120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.613399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.613669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.614321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:30.614619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.616054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.622451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd1b1f-a991-49ad-bf41-886380e4d2ee None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.623753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 327/637] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:30.624551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.663811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.664433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.664714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.664991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.665651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:30.665954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.667364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.679847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 311/638] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:30.680718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.689788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.742754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98864eb4-e235-4068-8e70-65c633a5a296 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.775964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.776617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.776901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.777171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.781317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb432891-62c7-4c7e-9e05-9446bcf29d0d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.786963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:30.792188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:30.793241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 328/639] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:30.794096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.816513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.817134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.817410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.817676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.824635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.826067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.829481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:30.837106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:30.838028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:30.838927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 312/640] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:30.839418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.898281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e1c94-b3ff-4eea-afe2-bb73574a866a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.904541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:30.930467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.931088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.931369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.931642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.937978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614736ad-3afe-42a5-9acb-517340a27617 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:30.941742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.943184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:30.957508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:30.958571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:30.960067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:30.960067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:30.960067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:30.960067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 329/641] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:30.960329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:30.974891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:30.975485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:30.975758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:30.976025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:30.976766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:30.977067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:30.978469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:30.984680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 313/642] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/role_assignments?user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:30.985361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.059796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.076093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1193-4f97-4b6c-bdf1-638b324efb15 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.100741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c336f4-9f60-4bef-9496-d09b0a3e66a4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.114720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.115400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.115672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.115945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.129539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:31.135399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:31.136464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:31.137452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 330/643] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:31.138176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.142949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.151878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.152660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.152942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.153216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.153871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:31.154173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.155567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.165094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 314/644] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:31.165748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.246290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97589f3-89c0-426c-a0bd-f81ea04c6e63 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.276188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b10522-2bf3-4ab1-a425-e036c6f8c3fb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.280640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.281247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.281528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.281796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.282488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:31.282791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.284218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.301083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 331/645] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:31.301083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.309881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.316288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.316925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.317209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.317466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.318098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:31.318398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.319869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.332292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 315/646] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:31.333054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.386473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.411091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380b444-a313-4bbe-a31e-c7e10b8580a2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.439896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16981954-c055-4a93-b63c-8d6c541cab2c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.448886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.449493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.449766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.450034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.450688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:31.450982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.452346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.460807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 332/647] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:31.461613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.487813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.489254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.489894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.490286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.501546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.503119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:31.518206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:31.519378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:31.520287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:31.520287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:31.520287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:31.520287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 316/648] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:31.520556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.538804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.574380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f07fd-2173-4018-994a-e9d98be98df6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.612228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.613022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.613300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.613691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/6f2ae343d97d49be9d3d6b430a61a48f/roles/80e9dd6f85584a769f314f6f052c4cc2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.627675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f19c9-8731-45e5-abfa-69d7af7dde9e None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.629115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=6f2ae343d97d49be9d3d6b430a61a48f, role_id=80e9dd6f85584a769f314f6f052c4cc2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.629948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.631870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.656425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 333/649] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:31 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/6f2ae343d97d49be9d3d6b430a61a48f/roles/80e9dd6f85584a769f314f6f052c4cc2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:31.656425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.678530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.679191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.679529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.679898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.689216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.690897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:31.704522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:31.705680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:31.706643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 317/650] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:31.707527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.783146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752f942-9fe5-4f48-b1de-351c78070051 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.806664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.825241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.825241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.825531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.825804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.839034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.840459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.844861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccbecb-4224-43a0-b3fc-377b4d9be506 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:31.860994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:31.862037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:31.863231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:31.863231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:31.863231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:31.863231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 334/651] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:31.864570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.892629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:31.893552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:31.893833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:31.894104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:31.894971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:31.895629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:31.897518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:31.911643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 318/652] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:31.913057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:31.941741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:31.987113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588657d-eace-47c6-ad0b-8f8af37f07e4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.030896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4216912-549d-42c8-9b05-95f4ebff33e6 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.036842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.037521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.037803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.038073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.038811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:32.039114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.041153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.070866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 335/653] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:32.070866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.075731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.076733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.077191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.077690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.078590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:32.079084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.080679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.096642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 319/654] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:32.097791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.103937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.197289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dabdd-63b2-4259-aa84-6872d2f92a05 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.205555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.224347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276b51-932c-464d-a48c-97cf1b37de69 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.248556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.249676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.250126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.250923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.260714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.261478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.262146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.262491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.262827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.263058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:32.277230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:32.278408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:17:32.279581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:32.280414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 336/655] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:32.281256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.360725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.363103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.374028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.385822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8df7e5-ce9d-4dbd-b5ff-38d7c96f2ede None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.431139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.432887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.433378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.434323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.445373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.447071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.458791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:32.463207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:32.464156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 00:17:32.465168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:32.466601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 337/656] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:32.466778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.482590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 320/657] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:32.483592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.578544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044989d-329a-46bc-9288-ab39d21b5639 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.589832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd48bf-7e34-428f-9dd4-d82de6afc0ef None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.616610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.617620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.618155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.618754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.619688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:32.620192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.622082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.626428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.627039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.627311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.627579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.628357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:32.628696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.630162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.642933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 338/658] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:32.644066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.649676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 321/659] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:32.650627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.655785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.699962 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.755735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1355f9-c534-44ea-90c6-09803b52e10e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.763079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2385c86-8c59-469f-9e66-d184fb9c92e2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.793675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.794543 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.794885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.795201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.802009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.802877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.803841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.804251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.806961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.808747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:32.824573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:32.825623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:32.826746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:32.826746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:32.826746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:32.826746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 339/660] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:32.827586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:32.882420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:32.884211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:32.898359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.927365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:32.948081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac873-569a-4fda-98a4-acd95196955a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:32.987067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:32.987962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:32.988305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 322/661] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:32.988664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:32.989181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:32.989498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.062348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.063767 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.093780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c28018-b10b-42cf-a5e9-15cda82350be None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.131132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.134224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15765af-4646-4876-af11-46d1d2861818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.134867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15765af-4646-4876-af11-46d1d2861818 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.135090 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15765af-4646-4876-af11-46d1d2861818 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.135371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15765af-4646-4876-af11-46d1d2861818 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.135996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15765af-4646-4876-af11-46d1d2861818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:33.136301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15765af-4646-4876-af11-46d1d2861818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.137696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15765af-4646-4876-af11-46d1d2861818 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.151843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 323/662] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:33.153182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14eaaf-cc60-4494-92d2-b9ceff8c2d8b None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.153464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14eaaf-cc60-4494-92d2-b9ceff8c2d8b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.153735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14eaaf-cc60-4494-92d2-b9ceff8c2d8b None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.158866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 324/663] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:33.158866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14eaaf-cc60-4494-92d2-b9ceff8c2d8b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.161291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.185158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 340/664] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:33.186199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.270165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14eaaf-cc60-4494-92d2-b9ceff8c2d8b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.293024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0d601-6314-4ee6-8fad-6d911a16dfba None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.305829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edbbfc-4135-4159-9e75-0417a0050892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.306555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edbbfc-4135-4159-9e75-0417a0050892 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.306898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edbbfc-4135-4159-9e75-0417a0050892 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.307235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edbbfc-4135-4159-9e75-0417a0050892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.318437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edbbfc-4135-4159-9e75-0417a0050892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.320466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edbbfc-4135-4159-9e75-0417a0050892 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.329076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.329798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.330172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.330477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-49edbbfc-4135-4159-9e75-0417a0050892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:33.335332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:33.336282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:33.337791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:33.337791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:33.337791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:33.337791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 325/665] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:33.338028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58226cd-f13a-4f92-b1a7-3c91bfa98ff8 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.338246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58226cd-f13a-4f92-b1a7-3c91bfa98ff8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.338515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58226cd-f13a-4f92-b1a7-3c91bfa98ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.341723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.343212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:33.355361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:33.356294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 341/666] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:33.362427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.362982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d58226cd-f13a-4f92-b1a7-3c91bfa98ff8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:33.363410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d58226cd-f13a-4f92-b1a7-3c91bfa98ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:33.385353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.417674 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.444356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 326/667] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:33.444356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58226cd-f13a-4f92-b1a7-3c91bfa98ff8 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.476473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48a70-5acd-40b0-987a-cd9ee3f3213b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.515910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.516764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.517172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.517577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.529618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.531253 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:33.548227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:33.549440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:33.550545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:33.550545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:33.550545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:33.556606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 342/668] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:33.556606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.579367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58226cd-f13a-4f92-b1a7-3c91bfa98ff8 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.630316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.632285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.633157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.633771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.634207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.634996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:33.635534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.638173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.660418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 327/669] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:33.660418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.672270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1d1b-4b79-4c8f-ac4d-1c74f8989241 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.708756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.710129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.710683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.710960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.711651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:33.711956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.713551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.716583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.735442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 343/670] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:33.735442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.782053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2c58c-c44f-4657-9358-606df82cffc3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.814710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254e650-99b7-4c23-9b38-362e88750e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.815305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254e650-99b7-4c23-9b38-362e88750e28 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.815580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254e650-99b7-4c23-9b38-362e88750e28 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.815849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254e650-99b7-4c23-9b38-362e88750e28 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.816512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254e650-99b7-4c23-9b38-362e88750e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:33.816808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254e650-99b7-4c23-9b38-362e88750e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.818164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254e650-99b7-4c23-9b38-362e88750e28 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.830031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 328/671] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:33.831108 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8d89-273f-498a-9111-e653519cae53 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.831386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8d89-273f-498a-9111-e653519cae53 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.831652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8d89-273f-498a-9111-e653519cae53 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.832867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 329/672] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:33.833547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8d89-273f-498a-9111-e653519cae53 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.839279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aaed0-4b44-45f9-9e88-8c9e74fda579 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.868905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.873952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.874578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.874855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.875128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.882264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:33.883720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:33.894608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:33.895539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:33.896469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 344/673] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:33.897699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.939878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8d89-273f-498a-9111-e653519cae53 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:33.942613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:33.975825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:33.976464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:33.976740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:33.977003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:33.987270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:33.992161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:33.993281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 330/674] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:33.994134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:33.999145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a757-92b9-489b-989e-5f05dd8fa0e8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.033322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fbb39-b512-45ee-ae6d-f115994e0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.033916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fbb39-b512-45ee-ae6d-f115994e0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.034527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fbb39-b512-45ee-ae6d-f115994e0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.034808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fbb39-b512-45ee-ae6d-f115994e0dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.035518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fbb39-b512-45ee-ae6d-f115994e0dc7 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=fae893320e6c4ab996cdc2230172417e) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:34.036122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fbb39-b512-45ee-ae6d-f115994e0dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.038107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fbb39-b512-45ee-ae6d-f115994e0dc7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.043636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 345/675] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/role_assignments?user.id=fae893320e6c4ab996cdc2230172417e&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:34.044762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dadb7-64ff-4423-b688-c667c0a63f4b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.045321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dadb7-64ff-4423-b688-c667c0a63f4b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.045321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dadb7-64ff-4423-b688-c667c0a63f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.069795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-802dadb7-64ff-4423-b688-c667c0a63f4b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:34.071036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-802dadb7-64ff-4423-b688-c667c0a63f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:34.097713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40290-67c2-4153-8d27-f039d68454d0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.131689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:34.140052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.140982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.141258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.141680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.160414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 346/676] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:34.160414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dadb7-64ff-4423-b688-c667c0a63f4b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.163394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.165753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:34.182565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:34.183603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:34.184526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 331/677] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:34.185036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.215965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:34.283556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dadb7-64ff-4423-b688-c667c0a63f4b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.298893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b553aa-17fe-4ed9-a5e9-6523d7d630d2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.325857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.326622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.326908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.327179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.327869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:34.328176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.329878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.335910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.336548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.336811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.337077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.337729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:34.338075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.339376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.348578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 347/678] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:34.349171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.351421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 332/679] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:34.354932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.413553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:34.461108 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:34.474843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19febe-c275-46f0-833f-227aa58d8324 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.477757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50355a-b094-46d0-9d91-24c735bde893 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.512080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.512725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.513008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.513281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.513982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:34.514285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.515750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.516791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.517399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.517671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.517936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.518651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=b5a31dd48b6b4377a0eb375502344dcf) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:34.518955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.520351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.536417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 333/680] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/role_assignments?user.id=b5a31dd48b6b4377a0eb375502344dcf&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:34.536417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.536668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 348/681] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:34.540505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.668792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d37f1-e5aa-49c7-b164-bb44a0750096 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.673563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c5c40-68f7-4811-9aee-abb7ac119df6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.683639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:34.713423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.714307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.714678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.715026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.720073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.720740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.721019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.721285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.729453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.730907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.738253 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:34.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:34.747096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:34.747952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:34.748708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:34.749572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:34.750498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:34.750498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:34.750498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:34.752220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 349/683] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:34.753079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 334/683] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:34.753193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.753811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.758115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:34.863443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e47955-2c43-4f5f-bab1-13938b1a48d9 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.883258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e88f-16ea-4975-ba98-03afa1d87a52 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:34.899521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.900226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.900600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.900943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.901674 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:34.902107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.903546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.922074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 335/684] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:34.922074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.932888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:34.933759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:34.934203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:34.934634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:34.935716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=baa7f3487b674e75afe5fca74db44807) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:34.936215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:34.937945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:34.944781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 350/685] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/role_assignments?user.id=baa7f3487b674e75afe5fca74db44807&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:34.945772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:34.981815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:35.021635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:35.064499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742325bf-da51-4ce6-8a78-a42404e0cb9a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.066246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4a53f-04cc-480f-b782-1b8acc3cd029 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.115664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.116398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.116756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.117094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.117818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:35.119598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.121106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.143709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 336/686] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:35.145005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.145815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.146165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.146509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.148145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:35.169364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.170946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:35.185575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:35.186819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:35.187822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:35.187822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:35.187822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:35.189527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 351/687] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:35.194599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:35.282345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64efef-2c61-44a3-bef7-7d62ab90d45e None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.308596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:35.314188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:35.322360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.323112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.323462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.324912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.332332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.333897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.337209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca3a1-5e93-4f82-aeb3-aa4e30c0553f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:35.356149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:35.357443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:35.358669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:35.361931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 337/688] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:17:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:35.369237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:35.385802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.386691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.387088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.387456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.388671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:35.388671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.390019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.404231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 352/689] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:35.409910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:35.494389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240d85a-f326-4580-8c77-6f085ad4f000 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.523204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3228ed-f1ac-4c10-be76-1b811d427e7b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.550229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.550849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.551131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.551402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.552140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:35.554593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.556423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.577033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 338/690] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:17:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:35.584500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:35.586307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.587317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.587814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.588336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.597247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.599227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:35.619656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:35.620691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:35.621650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:35.626980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 353/691] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:35.633275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:35.639503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:35.679154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:35.768154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed901b2-07b9-49d4-bedb-969e1d7f92d1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.812692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.813323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.813605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.813870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.839159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603694ad-8046-4226-b5c5-c5f2893945ef None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:35.900471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:35.901241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:35.901473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:35.901750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:35.902479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:35.902808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.904218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.908889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:35.910577 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:35.939822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 354/692] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Sep 1 00:17:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:35.946193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:35.954213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:36.031581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 339/693] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:36.036465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:36.064757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:36.150560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777861-ee9e-485f-bec3-fe95c634f812 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:36.180062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62c9b2-389a-48aa-9c6a-bb542aa60565 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:36.222818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:36.223453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.223732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.224002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.227997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:36.228901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.229181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.229458 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.248086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:36.249691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:36.251802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:36.275543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:36.276612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:36.277527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:36.277527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:36.277527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:36.277527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 340/694] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:36.285527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:36.313265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:36.315048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:36.382985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:36.434380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 355/695] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 00:17:36.435851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:36.475959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316cf53-888f-4872-b25b-7b66f17b2718 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:36.517781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3246de-9cc1-4e01-9b34-aa7f48043bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:36.518406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3246de-9cc1-4e01-9b34-aa7f48043bc8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.518682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3246de-9cc1-4e01-9b34-aa7f48043bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.518939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3246de-9cc1-4e01-9b34-aa7f48043bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.519591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3246de-9cc1-4e01-9b34-aa7f48043bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:36.519894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3246de-9cc1-4e01-9b34-aa7f48043bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:36.522443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3246de-9cc1-4e01-9b34-aa7f48043bc8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:36.538812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 341/696] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:36.540418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156ff34-9ff0-4170-94ac-1ca0f231a2c2 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.540710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156ff34-9ff0-4170-94ac-1ca0f231a2c2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.540982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156ff34-9ff0-4170-94ac-1ca0f231a2c2 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.546629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 342/697] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:36.546629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156ff34-9ff0-4170-94ac-1ca0f231a2c2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:36.564246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205be1-add0-42d1-84fd-815973bb2933 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:36.603223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150ee1e-601f-4c28-b550-1d3f2b80af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:36.604913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150ee1e-601f-4c28-b550-1d3f2b80af84 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.605696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150ee1e-601f-4c28-b550-1d3f2b80af84 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.606197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150ee1e-601f-4c28-b550-1d3f2b80af84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.619516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150ee1e-601f-4c28-b550-1d3f2b80af84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:36.619891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:36.622046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150ee1e-601f-4c28-b550-1d3f2b80af84 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1150ee1e-601f-4c28-b550-1d3f2b80af84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:36.641288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:36.642292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:36.643207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:36.643207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:36.643207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:36.645689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 356/698] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:36.647676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ea4f4-c79b-48bd-b77d-50d890d9a229 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.648171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ea4f4-c79b-48bd-b77d-50d890d9a229 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.648673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ea4f4-c79b-48bd-b77d-50d890d9a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.669316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5b2ea4f4-c79b-48bd-b77d-50d890d9a229 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:36.670677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5b2ea4f4-c79b-48bd-b77d-50d890d9a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:36.679297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:36.682179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156ff34-9ff0-4170-94ac-1ca0f231a2c2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:36.719829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:36.720510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.720793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.721065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.728020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:36.729747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:36.741549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:36.742486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 343/699] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:36.744129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:36.748671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 357/700] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:36.749884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4da39e-7c27-4e77-ad4e-6bcf8e157ade None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.750173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4da39e-7c27-4e77-ad4e-6bcf8e157ade None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.750442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4da39e-7c27-4e77-ad4e-6bcf8e157ade None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.756829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 358/701] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:36.756829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4da39e-7c27-4e77-ad4e-6bcf8e157ade None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:36.861657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b08a-49e5-44d1-89fd-0c58652195a1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:36.875631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:36.882784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4da39e-7c27-4e77-ad4e-6bcf8e157ade None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:36.900098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12701e-8df5-4793-ae46-ef9a61a9c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:36.900892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12701e-8df5-4793-ae46-ef9a61a9c194 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.901192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12701e-8df5-4793-ae46-ef9a61a9c194 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.901700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12701e-8df5-4793-ae46-ef9a61a9c194 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.902092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12701e-8df5-4793-ae46-ef9a61a9c194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:36.902397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12701e-8df5-4793-ae46-ef9a61a9c194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:36.903773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12701e-8df5-4793-ae46-ef9a61a9c194 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:36.920958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 344/702] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:36.920958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ae76-e858-4564-b5ff-3233c1da60cb None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.920958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ae76-e858-4564-b5ff-3233c1da60cb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.920958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ae76-e858-4564-b5ff-3233c1da60cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.932366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:36.933462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:36.934053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:36.934508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:36.935399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:36.935882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:36.937540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:36.938023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-8396ae76-e858-4564-b5ff-3233c1da60cb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:36.939366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8396ae76-e858-4564-b5ff-3233c1da60cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:36.953537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 359/703] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:36.955217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:36.958867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:37.015194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 345/704] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:37.016437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396ae76-e858-4564-b5ff-3233c1da60cb None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.092187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2357-8a01-4871-bee7-b8933cc4512b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.124050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396ae76-e858-4564-b5ff-3233c1da60cb None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.127858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:37.140362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.141392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.141744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.142089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.151220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.153324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.166412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.167411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.168038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.168600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.169551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:37.170034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.171698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:37.173943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:37.174835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 360/705] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:37.181036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.186742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 346/706] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/role_assignments?user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:37.187947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.266410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:37.312282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50b1fc-3003-4749-b296-3f1079826885 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.325024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e28c1c-c2ec-4a6e-b952-cab4abd828cf None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.361078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.362035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.362495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.362952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.363830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:37.364332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.364822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.365986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.366265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.366536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.367316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.379980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.386368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 347/707] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:37.386548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.386964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:37.405719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:37.406923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:37.408047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:37.408047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:37.408047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:37.412540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 361/708] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:37.413473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.422519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:37.516849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb548e-27d6-492e-b510-fefecd41aedd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.531852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2d18c-dbd2-43f1-8c0c-d33033acf1d8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.547205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:37.557787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.557787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.557787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.558090 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.558498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.559874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:37.571902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:37.573062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:37.573975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:37.574749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a4815-17e6-4688-a156-f9554846c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.574837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 348/709] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:37.574837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.577794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a4815-17e6-4688-a156-f9554846c418 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.578157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a4815-17e6-4688-a156-f9554846c418 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.578321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a4815-17e6-4688-a156-f9554846c418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.579668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a4815-17e6-4688-a156-f9554846c418 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=6f2ae343d97d49be9d3d6b430a61a48f) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:37.579668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a4815-17e6-4688-a156-f9554846c418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.580801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a4815-17e6-4688-a156-f9554846c418 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.593058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 362/710] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/role_assignments?user.id=6f2ae343d97d49be9d3d6b430a61a48f&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:37.593058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d2b87-2780-429a-8a05-c6a9e3d8b282 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.593058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d2b87-2780-429a-8a05-c6a9e3d8b282 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.593058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d2b87-2780-429a-8a05-c6a9e3d8b282 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.593058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 363/711] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:37.593058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d2b87-2780-429a-8a05-c6a9e3d8b282 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.698155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:37.709498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e46ff-aa90-4507-b43f-4f059800b5e2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.750204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d2b87-2780-429a-8a05-c6a9e3d8b282 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:37.753470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab9ab7-aa01-4ae2-a882-956277ec5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.754091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9ab7-aa01-4ae2-a882-956277ec5121 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.754371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9ab7-aa01-4ae2-a882-956277ec5121 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.754641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab9ab7-aa01-4ae2-a882-956277ec5121 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.755286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab9ab7-aa01-4ae2-a882-956277ec5121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:37.755586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab9ab7-aa01-4ae2-a882-956277ec5121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.757102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab9ab7-aa01-4ae2-a882-956277ec5121 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.772631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 349/712] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:37.776471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422257e-d276-4abc-8717-43f7b5ffc355 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.776471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422257e-d276-4abc-8717-43f7b5ffc355 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.776471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422257e-d276-4abc-8717-43f7b5ffc355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.793673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:37.794606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:37.795101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:37.795565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:37.796542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:37.797036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:37.797277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7422257e-d276-4abc-8717-43f7b5ffc355 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:37.798469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7422257e-d276-4abc-8717-43f7b5ffc355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:37.799110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:37.804370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 364/713] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:37.805390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.856724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:37.883605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 350/714] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:37.885036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422257e-d276-4abc-8717-43f7b5ffc355 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:37.949319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5af21f-4c0f-493c-998e-bf6fd65056dc None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:38.002415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:38.003077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:38.003358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:38.003630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:38.004274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:38.005726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:38.010571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:38.043955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422257e-d276-4abc-8717-43f7b5ffc355 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:38.045401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 365/715] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:17:37 2022] POST /identity/v3/users => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:38.087657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:38.088279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:38.088585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:38.088853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:38.089505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:38.089869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:38.091318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:38.102586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 351/716] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Sep 1 00:17:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:38.202792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:38.312661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:38.319303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757d64-c91f-403b-bb20-231fb57cdc70 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:38.359899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:38.360581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:38.360863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:38.361137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] PATH_INFO: `/v3/services/network` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:38.361738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:38.363117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:38.375054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:38.376083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:38.376982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 366/717] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:38 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:38.382856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:38.497780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6580d7-4b35-4f45-a9f5-5c8a166d820a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:38.545277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a1f4d-a821-41f8-873e-5a1ef9439600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:38.545972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a1f4d-a821-41f8-873e-5a1ef9439600 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:38.546251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a1f4d-a821-41f8-873e-5a1ef9439600 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:38.546519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a1f4d-a821-41f8-873e-5a1ef9439600 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:38.547142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a1f4d-a821-41f8-873e-5a1ef9439600 None admin] RBAC: Adding query filter params (name=network) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:38.547440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a1f4d-a821-41f8-873e-5a1ef9439600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:38.548918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a1f4d-a821-41f8-873e-5a1ef9439600 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:38.553833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 352/718] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:17:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:38.559395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:38.698692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60228-73ff-41d5-9c16-5703c9a5fe0e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:38.766566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db957e8-57df-4d02-b5de-6ae0683b8f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:38.767111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db957e8-57df-4d02-b5de-6ae0683b8f3d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:38.767393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db957e8-57df-4d02-b5de-6ae0683b8f3d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:38.767666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db957e8-57df-4d02-b5de-6ae0683b8f3d None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:38.768311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db957e8-57df-4d02-b5de-6ae0683b8f3d None admin] RBAC: Adding query filter params (type=network) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:38.768642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db957e8-57df-4d02-b5de-6ae0683b8f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:38.770039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db957e8-57df-4d02-b5de-6ae0683b8f3d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:38.782519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 367/719] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:17:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:39.414778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351c166-abe6-40a3-ab91-455e0f8941c8 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:39.415302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351c166-abe6-40a3-ab91-455e0f8941c8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:39.415575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351c166-abe6-40a3-ab91-455e0f8941c8 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:39.417088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 353/720] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:39.422277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53262d-ff2c-406e-85a2-df2d165f332b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:39.422563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53262d-ff2c-406e-85a2-df2d165f332b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:39.422837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53262d-ff2c-406e-85a2-df2d165f332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:39.453411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ac53262d-ff2c-406e-85a2-df2d165f332b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:39.454619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ac53262d-ff2c-406e-85a2-df2d165f332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:39.477436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:39.546612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 368/721] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:39.898925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7b4a-de4b-4222-9f13-761b92f153aa None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:39.899305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7b4a-de4b-4222-9f13-761b92f153aa None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:39.899508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7b4a-de4b-4222-9f13-761b92f153aa None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:39.901121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 354/722] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:39.906439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074d2a-ed86-45bc-a4ad-c53957a2bd02 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:39.906877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074d2a-ed86-45bc-a4ad-c53957a2bd02 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:39.907043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074d2a-ed86-45bc-a4ad-c53957a2bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:39.923472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da7b4a-de4b-4222-9f13-761b92f153aa None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:39.926294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3b074d2a-ed86-45bc-a4ad-c53957a2bd02 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:39.927699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3b074d2a-ed86-45bc-a4ad-c53957a2bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:39.936691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:40.031476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 369/723] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 00:17:40.089227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da7b4a-de4b-4222-9f13-761b92f153aa None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:40.131530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:40.132571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.133057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.133555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.149984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:40.155498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:40.156455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:40.157333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:40.164479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 355/724] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:40.169482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b074d2a-ed86-45bc-a4ad-c53957a2bd02 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:40.296703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:40.319211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b074d2a-ed86-45bc-a4ad-c53957a2bd02 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:40.362512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:40.363178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.363464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.363739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.364453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:40.364761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:40.366729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:40.379974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 370/725] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:40.385594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:40.456256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:40.472893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:40.507000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290cee-93d0-4798-a43b-a44149ecd146 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:40.549471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd976a43-8f1e-4216-9004-f301510cdf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:40.550099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976a43-8f1e-4216-9004-f301510cdf76 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.550377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976a43-8f1e-4216-9004-f301510cdf76 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.550643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976a43-8f1e-4216-9004-f301510cdf76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.567177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd976a43-8f1e-4216-9004-f301510cdf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:40.569298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd976a43-8f1e-4216-9004-f301510cdf76 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-fd976a43-8f1e-4216-9004-f301510cdf76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:40.584093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:40.585349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:40.586330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:40.586330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:40.586330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:40.586330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 356/726] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:40.587009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6ca3-9e18-4317-a905-c39ae115c211 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.587009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6ca3-9e18-4317-a905-c39ae115c211 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.587259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6ca3-9e18-4317-a905-c39ae115c211 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.592856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 357/727] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:40.592856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6ca3-9e18-4317-a905-c39ae115c211 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:40.619172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957b364-54e5-46e3-a50f-0e7ddd58278d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:40.656035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be56f2-f265-4476-aa90-6171e9c2e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:40.656746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be56f2-f265-4476-aa90-6171e9c2e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.657077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be56f2-f265-4476-aa90-6171e9c2e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.657349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be56f2-f265-4476-aa90-6171e9c2e6e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.669229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be56f2-f265-4476-aa90-6171e9c2e6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-f0be56f2-f265-4476-aa90-6171e9c2e6e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:40.675062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:40.676026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:40.676940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 371/728] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:40.677678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83688d3b-64f2-4dc9-adc5-b22c72470d92 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.682563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83688d3b-64f2-4dc9-adc5-b22c72470d92 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.682958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83688d3b-64f2-4dc9-adc5-b22c72470d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.701585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-83688d3b-64f2-4dc9-adc5-b22c72470d92 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:40.702767 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-83688d3b-64f2-4dc9-adc5-b22c72470d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:40.704986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:40.721074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6ca3-9e18-4317-a905-c39ae115c211 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:40.745563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:40.758621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363a4f0-b667-42ad-a291-3d7bf10eec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:40.759228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a4f0-b667-42ad-a291-3d7bf10eec37 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.759507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a4f0-b667-42ad-a291-3d7bf10eec37 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.760068 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a4f0-b667-42ad-a291-3d7bf10eec37 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.760473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363a4f0-b667-42ad-a291-3d7bf10eec37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:40.760778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363a4f0-b667-42ad-a291-3d7bf10eec37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:40.762196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363a4f0-b667-42ad-a291-3d7bf10eec37 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:40.774376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 372/729] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:40.774999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83688d3b-64f2-4dc9-adc5-b22c72470d92 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:40.789779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 358/730] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:40.789779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637d77e-4cb0-4d13-8ece-51868660a4bb None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.789779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637d77e-4cb0-4d13-8ece-51868660a4bb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.789779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637d77e-4cb0-4d13-8ece-51868660a4bb None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.789779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 359/731] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:40.791702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637d77e-4cb0-4d13-8ece-51868660a4bb None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:40.915902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83688d3b-64f2-4dc9-adc5-b22c72470d92 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:40.922083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637d77e-4cb0-4d13-8ece-51868660a4bb None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:40.956668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e53d-d77a-4041-be63-c37fbdf900dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:40.957424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e53d-d77a-4041-be63-c37fbdf900dd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.957935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e53d-d77a-4041-be63-c37fbdf900dd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.958173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e53d-d77a-4041-be63-c37fbdf900dd None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.959464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9e53d-d77a-4041-be63-c37fbdf900dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:40.959891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9e53d-d77a-4041-be63-c37fbdf900dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:40.961473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9e53d-d77a-4041-be63-c37fbdf900dd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:40.967365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:40.971722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 373/732] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:40.973163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516352-5738-4383-b157-629203114ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:40.973379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c37271-cca9-4197-b91f-247c0a30fdb4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.973818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c37271-cca9-4197-b91f-247c0a30fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.974333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516352-5738-4383-b157-629203114ee9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:40.974544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c37271-cca9-4197-b91f-247c0a30fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.975235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516352-5738-4383-b157-629203114ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:40.975740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516352-5738-4383-b157-629203114ee9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:40.985952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516352-5738-4383-b157-629203114ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:40.987737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516352-5738-4383-b157-629203114ee9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:40.998397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e8c37271-cca9-4197-b91f-247c0a30fdb4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:40.999768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e8c37271-cca9-4197-b91f-247c0a30fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-a1516352-5738-4383-b157-629203114ee9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:41.001217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:41.002336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:41.003523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:41.009821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 360/733] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:17:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:41.010716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516352-5738-4383-b157-629203114ee9 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.058840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:41.092411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 374/734] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:41.092411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c37271-cca9-4197-b91f-247c0a30fdb4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.128047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516352-5738-4383-b157-629203114ee9 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.170162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.171569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.171847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.172118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.186050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.187804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.201708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c37271-cca9-4197-b91f-247c0a30fdb4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:41.212086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:41.213166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:41.214437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:41.214437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:41.214437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:41.215540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 361/735] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:41.216319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.252848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:41.261337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.261965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.262230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.262559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.263308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:41.263670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.265150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.292424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 375/736] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:41.292900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.329812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:41.338678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdd69e-cf63-436b-9d09-86bd9343b796 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.374763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f07dcc-90f0-4895-809d-5c021dbd9821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.375386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07dcc-90f0-4895-809d-5c021dbd9821 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.375657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07dcc-90f0-4895-809d-5c021dbd9821 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.375929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07dcc-90f0-4895-809d-5c021dbd9821 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.386063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f07dcc-90f0-4895-809d-5c021dbd9821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-85f07dcc-90f0-4895-809d-5c021dbd9821 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:41.391271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:41.392360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:41.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 362/737] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:41.394241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63b563-c733-4584-8abe-97addce947ef None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.394241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63b563-c733-4584-8abe-97addce947ef None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.394241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63b563-c733-4584-8abe-97addce947ef None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.395542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 363/738] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:41.397548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63b563-c733-4584-8abe-97addce947ef None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.400064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcb11-8100-4b2f-af70-719155075279 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.436938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.437544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.437824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.438096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.438736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:41.439036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.440460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.451759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 376/739] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:41.452577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.500600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63b563-c733-4584-8abe-97addce947ef None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.501181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:41.534283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.534901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.535176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.535442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.546274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.547718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.555892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685048-0ddc-4ed0-9bac-8618107566e7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:41.561827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:41.562883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:41.569105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:41.569105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:41.569105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:41.569105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 364/740] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:41.569105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.573940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:41.590942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e86050-6bc5-4b51-a614-3aa5b88daa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.591548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86050-6bc5-4b51-a614-3aa5b88daa3c None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.591832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86050-6bc5-4b51-a614-3aa5b88daa3c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.592105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86050-6bc5-4b51-a614-3aa5b88daa3c None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.592803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e86050-6bc5-4b51-a614-3aa5b88daa3c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.594175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e86050-6bc5-4b51-a614-3aa5b88daa3c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.610758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 377/741] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:17:41 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:41.611765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb0fd-a8d2-4942-b14f-20d1f6f5a66d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.612049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb0fd-a8d2-4942-b14f-20d1f6f5a66d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.612325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb0fd-a8d2-4942-b14f-20d1f6f5a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.634353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3bfbb0fd-a8d2-4942-b14f-20d1f6f5a66d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:41.635929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3bfbb0fd-a8d2-4942-b14f-20d1f6f5a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:41.676427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938726aa-8f63-4309-942c-7fc5794e6799 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.723175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 378/742] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 00:17:41.723965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbb0fd-a8d2-4942-b14f-20d1f6f5a66d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.734814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.735777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.736195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.736690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.737559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:41.738003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.739624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.750479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 365/743] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:41.751548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.778680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:41.839262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:41.867833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbb0fd-a8d2-4942-b14f-20d1f6f5a66d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.875771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5768d3-1c60-45c2-92df-6a4f2d94d14b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:41.911095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.911703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.912002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.912345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.913004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:41.913308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.914672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.916189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:41.917877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:41.918389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:41.918880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:41.928750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:41.930476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:41.931300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 366/744] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:41.932179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:41.947529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:41.948573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:41.949547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:41.952461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 379/745] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:41.953472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.044742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4342313-93ae-489a-9c9e-ad94e79805dd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.063299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:42.071701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:42.071895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30becafe-74bf-41f9-b4cc-b530845b85ec None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.084690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.085356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.085593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.085887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.097913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.099440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.110077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.110707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.111017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.111285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:42.114831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:42.115831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:42.116804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:42.116804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:42.116804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:42.116804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 367/746] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:42.117501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.123074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.124576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:42.138344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:42.139288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 380/747] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:42.140198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.241048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f838437-71fc-416d-923f-1b9d64bec14d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.246903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c101144-bba3-4de4-ad3b-47cafe5e3864 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.278000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.278613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.278892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.279167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.279886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:42.280193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.281668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.284786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.285396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.285677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.285950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.286602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.288528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.305111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 368/748] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Sep 1 00:17:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:42.305111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.306930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 381/749] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:17:42 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:42.307803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.325771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:42.353963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:42.432864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6fd15-a695-486d-b053-64fdbd4f39fd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.435306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d1d15-365f-4826-9ded-bf3517907e2f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.476266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.476940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.477220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.477325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.477500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.477850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.478131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.478229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:42.478401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.478763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.479288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:42.479588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.480174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.481210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.495594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 382/750] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:42.496531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.497069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 369/751] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:42.501012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.601531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:42.623926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:42.633127 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b5c3-b99b-4918-8ddd-8d265bd4e5e8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.636543 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce53abb-9114-461f-9c1d-a9423b43fda5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.676114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.676357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.677122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.677295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.677516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.678388 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.678502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/c63bab6bcfed4cb3b05de6ad4a4b43a4/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.678906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.680536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=c63bab6bcfed4cb3b05de6ad4a4b43a4, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.682341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.702546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 370/752] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:42 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/c63bab6bcfed4cb3b05de6ad4a4b43a4/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:17:42.703484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.775738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.778100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.830521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a61b0-b871-4918-b3d2-3f3374d58b10 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:42.867797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:42.868801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:42.869344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:42.869844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:42.874281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:42.879416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:42.881866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:42.894621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:42.895624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:42.896687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:42.899227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 371/753] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:17:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:42.905186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.913352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 383/754] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:17:42.920438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:42.940838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:43.026927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a9031-3ed0-4196-aee9-f72f557eaeb2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:43.043826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129bfb9-c5f0-45f8-9f68-c442dc734a80 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:43.063924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:43.064588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.064866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.065131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.076347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:43.077847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:43.084835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:43.087167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.087676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.088188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.089147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:43.089660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:43.091308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:43.093287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:43.094245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:43.095159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:43.095159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:43.095159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:43.095159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 384/755] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:43.100571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:43.125581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 372/756] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Sep 1 00:17:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:43.126187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:43.133512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:43.215104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08acc3-6a5f-4bd9-b8c2-5a485bc4c047 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:43.255101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:43.255840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.256659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.256926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.257544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:43.257834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:43.259208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:43.277375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:43.290165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 385/757] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:43.297386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:43.324256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c0037-d26e-4171-a3bc-8016bf6c12a4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:43.384315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd1303-3911-44ef-ac60-591535159b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:43.384939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd1303-3911-44ef-ac60-591535159b71 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.385212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd1303-3911-44ef-ac60-591535159b71 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.385477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd1303-3911-44ef-ac60-591535159b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.463075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:43.495264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0768c-92a1-4e74-b21e-032335ac3f8a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:43.540030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:43.540703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.540980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.541250 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.548007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:43.549569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:43.550794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd1303-3911-44ef-ac60-591535159b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:43.552322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd1303-3911-44ef-ac60-591535159b71 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:43.560983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:43.561955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:43.563314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 386/758] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:43.568027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:43.680817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6d3a-ef4a-4fda-9fc0-040bd6befb03 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:43.716930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:43.717541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.717819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.718088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.718771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:43.719526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:43.721076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:43.734963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 387/759] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:43.741668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:43.745942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:43.784491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:43.850639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974a2b1-79df-4ba9-9215-ebe679d4083a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:43.861345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 373/760] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 00:17:43.862803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c1f7-7e10-4610-9072-b4fe399ec441 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.863191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c1f7-7e10-4610-9072-b4fe399ec441 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.863560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c1f7-7e10-4610-9072-b4fe399ec441 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.865264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 374/761] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:43.867700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c1f7-7e10-4610-9072-b4fe399ec441 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:43.898037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918531f-444a-4e30-b856-97b8cd081444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:43.899190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918531f-444a-4e30-b856-97b8cd081444 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.899480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918531f-444a-4e30-b856-97b8cd081444 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.899759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918531f-444a-4e30-b856-97b8cd081444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.900613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918531f-444a-4e30-b856-97b8cd081444 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=6f2ae343d97d49be9d3d6b430a61a48f) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:43.901011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918531f-444a-4e30-b856-97b8cd081444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:43.902716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918531f-444a-4e30-b856-97b8cd081444 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:43.909576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 388/762] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:43 2022] GET /identity/v3/role_assignments?user.id=6f2ae343d97d49be9d3d6b430a61a48f&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:43.913738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad78c3-58ea-433b-a53c-54d203c1d16a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:43.914139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad78c3-58ea-433b-a53c-54d203c1d16a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:43.914514 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad78c3-58ea-433b-a53c-54d203c1d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:43.953592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c0ad78c3-58ea-433b-a53c-54d203c1d16a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:43.955548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c0ad78c3-58ea-433b-a53c-54d203c1d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:44.011405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c1f7-7e10-4610-9072-b4fe399ec441 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:44.070124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:44.082719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 389/763] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:44.084335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:44.085013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.085289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.085559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.097636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:44.099143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:44.116191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:44.117234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:44.118168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:44.118168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:44.118168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:44.118168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 375/764] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:44.125467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad78c3-58ea-433b-a53c-54d203c1d16a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:44.262157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad78c3-58ea-433b-a53c-54d203c1d16a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:44.310470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:44.311077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.311356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.311626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.312265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:44.312585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:44.313961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:44.330913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 390/765] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:44.336312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:44.378816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:44.392593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:44.493120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:44.539023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437695d7-4a4b-4142-ac2f-b59f298cd95d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:44.582556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ca152-eb91-42a1-8c2d-e2994e1cd2f1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:44.608040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:44.608734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.612429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.612429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.624735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:44.627529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:44.644015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:44.644947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:44.645859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:44.648214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 376/766] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:44.653937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:44.657626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42852b6-68cb-4e3b-ad53-5474944727c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:44.659183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42852b6-68cb-4e3b-ad53-5474944727c4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.659467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42852b6-68cb-4e3b-ad53-5474944727c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.659734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42852b6-68cb-4e3b-ad53-5474944727c4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.660324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42852b6-68cb-4e3b-ad53-5474944727c4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:44.661772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42852b6-68cb-4e3b-ad53-5474944727c4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-a42852b6-68cb-4e3b-ad53-5474944727c4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:44.673551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:44.674599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:44.675452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 391/767] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Sep 1 00:17:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:44.676251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58fbdc-adc7-44f5-a575-e4ec3cca5088 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.676929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58fbdc-adc7-44f5-a575-e4ec3cca5088 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.676929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58fbdc-adc7-44f5-a575-e4ec3cca5088 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.678631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 392/768] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:44.680284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58fbdc-adc7-44f5-a575-e4ec3cca5088 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:44.750999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:44.769567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3a90-446e-418b-bd68-80ade654d031 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:44.805872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccce81d-3fc8-4e03-ab59-ba30ecb8b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:44.806447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce81d-3fc8-4e03-ab59-ba30ecb8b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.806726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce81d-3fc8-4e03-ab59-ba30ecb8b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.806992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce81d-3fc8-4e03-ab59-ba30ecb8b4a7 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.807672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccce81d-3fc8-4e03-ab59-ba30ecb8b4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:44.807970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccce81d-3fc8-4e03-ab59-ba30ecb8b4a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:44.809444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccce81d-3fc8-4e03-ab59-ba30ecb8b4a7 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:44.815215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58fbdc-adc7-44f5-a575-e4ec3cca5088 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:44.826596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 377/769] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:44.827866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a18a-7cf8-4ff2-b3f5-bb181a8c6c62 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.828145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a18a-7cf8-4ff2-b3f5-bb181a8c6c62 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.828432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a18a-7cf8-4ff2-b3f5-bb181a8c6c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.843507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:44.846991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-bac5a18a-7cf8-4ff2-b3f5-bb181a8c6c62 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:44.848182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bac5a18a-7cf8-4ff2-b3f5-bb181a8c6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:44.863028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:44.864338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:44.865615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:44.866067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:44.867145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:44.868024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:44.869616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:44.876235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 393/770] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Sep 1 00:17:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:44.877470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:44.926633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 378/771] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:44.927701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5a18a-7cf8-4ff2-b3f5-bb181a8c6c62 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.005393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62279-aeae-4f43-b414-72f96a9abcda None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.012822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:45.036267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5a18a-7cf8-4ff2-b3f5-bb181a8c6c62 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.070933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893926fa-efa2-45f2-b047-2a225a1296d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.071886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893926fa-efa2-45f2-b047-2a225a1296d9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.072365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893926fa-efa2-45f2-b047-2a225a1296d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.072930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893926fa-efa2-45f2-b047-2a225a1296d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.073662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803234-fd13-480f-9274-d3d18525dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.074636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893926fa-efa2-45f2-b047-2a225a1296d9 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=b65fda206995485db38858538d48a176) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:45.074751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803234-fd13-480f-9274-d3d18525dfb3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.074831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893926fa-efa2-45f2-b047-2a225a1296d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:45.074901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803234-fd13-480f-9274-d3d18525dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.074901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803234-fd13-480f-9274-d3d18525dfb3 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.075521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803234-fd13-480f-9274-d3d18525dfb3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:45.075821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803234-fd13-480f-9274-d3d18525dfb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:45.076859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893926fa-efa2-45f2-b047-2a225a1296d9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:45.077263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803234-fd13-480f-9274-d3d18525dfb3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:45.084408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 379/772] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Sep 1 00:17:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:45.085370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88effac-eca2-42bc-9f2a-35f5e16e066c None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.085655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88effac-eca2-42bc-9f2a-35f5e16e066c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.086046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88effac-eca2-42bc-9f2a-35f5e16e066c None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.087497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 380/773] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:45.088526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88effac-eca2-42bc-9f2a-35f5e16e066c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.089190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 394/774] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:44 2022] GET /identity/v3/role_assignments?user.id=b65fda206995485db38858538d48a176&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:45.094290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a172c-63aa-46eb-b1c8-f0f295d7bbe8 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.094849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a172c-63aa-46eb-b1c8-f0f295d7bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.095373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a172c-63aa-46eb-b1c8-f0f295d7bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.115743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fb2a172c-63aa-46eb-b1c8-f0f295d7bbe8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:45.117362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fb2a172c-63aa-46eb-b1c8-f0f295d7bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:45.168453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:45.219358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 395/775] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:17:45.243824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88effac-eca2-42bc-9f2a-35f5e16e066c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.280747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.281788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.282271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.282767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.283687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] RBAC: Adding query filter params (interface=public, service_id=c4e3194743a94324825d8ff20a4d3a4c, region_id=RegionOne) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:45.284200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:45.285878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:45.295423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 381/776] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/endpoints?service_id=c4e3194743a94324825d8ff20a4d3a4c&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:45.301751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a172c-63aa-46eb-b1c8-f0f295d7bbe8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.309293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.312519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:45.420340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144ecd-5355-47ed-b9e9-63853d9c286c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.457176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.457922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.458201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.458472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] PATH_INFO: `/v3/services/network` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.459122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:45.460646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:45.466606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a172c-63aa-46eb-b1c8-f0f295d7bbe8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:45.470328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:45.471299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:45.472144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 382/777] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:45.477413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.512522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.513140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.513419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.513691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.514299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:45.515915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:45.522691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 396/778] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:45.559171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:45.597809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456578d-705e-4919-a461-9b2e4de9eeb4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.606211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.647636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.648314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.648572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.648845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.649744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] RBAC: Adding query filter params (name=network) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:45.650045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:45.652114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:45.658666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 383/779] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:45.664936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.668908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:45.779202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd4ef5-911b-4ea2-84dd-92f9f7fafdc7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.801657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3e74-5457-4c63-818c-6b1022273d1c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.828121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.828796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.829079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.829353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.839427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:45.842300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:45.847392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:45.848330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:45.848840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:45.849863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:45.850698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] RBAC: Adding query filter params (type=network) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:45.850807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:45.851683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:45.852563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:45.854312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:45.855901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:45.856729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 397/780] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:45.859222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.862387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 384/781] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:45.868615 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:45.992695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aac92-a205-47ed-ab9f-171a74968b3d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:45.994549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:46.000099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7f79b-7cc0-4e8b-8d10-4a0df351651e None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:46.033160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:46.033682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.033911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.034304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.035009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:46.035331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:46.037657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:46.046689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 398/782] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:46.047214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:46.048063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.048576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.049073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.049966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] RBAC: Adding query filter params (interface=public, service_id=c6849a2f80214d97a5c072ada5944d20, region_id=RegionOne) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:46.050473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:46.052048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:46.052338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:46.065287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 385/783] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:17:45 2022] GET /identity/v3/endpoints?service_id=c6849a2f80214d97a5c072ada5944d20&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:46.071439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:46.169119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef6a6-2332-4cda-974d-541457cc6490 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:46.170720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:46.223518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2d501-d440-4eb7-a01a-fdeb7988028f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:46.225621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4b742-0d6a-4ee4-98c8-46520d91c8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:46.226616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4b742-0d6a-4ee4-98c8-46520d91c8d6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.227038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4b742-0d6a-4ee4-98c8-46520d91c8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.227479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4b742-0d6a-4ee4-98c8-46520d91c8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.251401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4b742-0d6a-4ee4-98c8-46520d91c8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:46.253364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4b742-0d6a-4ee4-98c8-46520d91c8d6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:46.267149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:46.267757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.268028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.268295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.268924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:46.270294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:46.280492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 386/784] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:17:46 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-dbf4b742-0d6a-4ee4-98c8-46520d91c8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:46.288548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:46.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:46.290762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:46.290762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:46.290762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:46.290762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 399/785] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:46.297214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:46.386181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25bb61-5ce4-462d-817d-347d977a2ed8 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.386618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25bb61-5ce4-462d-817d-347d977a2ed8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.386811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25bb61-5ce4-462d-817d-347d977a2ed8 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.388057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 400/786] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:17:46.393609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc1a0a-667e-4ca7-aa2f-baf73410aa63 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.393875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc1a0a-667e-4ca7-aa2f-baf73410aa63 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.394145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc1a0a-667e-4ca7-aa2f-baf73410aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.423444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efd2fd-4049-4247-8c97-1ba17894cd4d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:46.437034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-acbc1a0a-667e-4ca7-aa2f-baf73410aa63 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:46.438273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-acbc1a0a-667e-4ca7-aa2f-baf73410aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:46.451375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:46.462277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:46.472508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:46.473124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.473405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.473667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.474341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:46.474680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:46.476066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:46.489441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 387/787] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:46.496999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:46.549814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 401/788] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:46.644987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56884bbe-c6a8-4068-8716-e252ce63d86f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:46.688573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:46.689193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.689514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.689781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.697648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:46.699140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:46.710794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:46.711765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:46.712830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 388/789] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:17:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:46.717567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc1a0a-667e-4ca7-aa2f-baf73410aa63 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:46.844184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc1a0a-667e-4ca7-aa2f-baf73410aa63 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:46.893104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:46.894098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:46.894583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:46.895083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:46.896020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:46.896626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:46.898267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:46.905651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:46.919684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 402/790] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:46.926569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:46.934247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:46.957006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:47.037469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9efe6-4209-4264-8d5d-1b67232858a9 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:47.097063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4760902-1aa1-45c4-9bf6-a52345b9c9f3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:47.107324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:47.108423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:47.108965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:47.109433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:47.129529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:47.135948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:47.136984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:47.137842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:47.144643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 389/791] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:47.146991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:47.153101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bf415-ac2b-4071-8fe2-a2c10d333e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:47.153733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf415-ac2b-4071-8fe2-a2c10d333e37 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:47.154015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf415-ac2b-4071-8fe2-a2c10d333e37 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:47.154287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf415-ac2b-4071-8fe2-a2c10d333e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:47.238673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bf415-ac2b-4071-8fe2-a2c10d333e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:47.240677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bf415-ac2b-4071-8fe2-a2c10d333e37 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:47.243834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:47.346415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3325df-04a9-411e-97b1-3f0c90a34fba None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:47.350041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:47.364750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 403/792] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 00:17:47.366396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffc98-8629-4f94-b7db-d2082eed28b4 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:47.366906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffc98-8629-4f94-b7db-d2082eed28b4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:47.367408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffc98-8629-4f94-b7db-d2082eed28b4 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:47.372422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 404/793] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:47.374172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffc98-8629-4f94-b7db-d2082eed28b4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:47.399640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5352c6-5750-4f47-8043-7e76d5110b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:47.400595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5352c6-5750-4f47-8043-7e76d5110b9d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:47.401670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5352c6-5750-4f47-8043-7e76d5110b9d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:47.402135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5352c6-5750-4f47-8043-7e76d5110b9d None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:47.403224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5352c6-5750-4f47-8043-7e76d5110b9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:47.403971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5352c6-5750-4f47-8043-7e76d5110b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:47.406307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5352c6-5750-4f47-8043-7e76d5110b9d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:47.418530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 390/794] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:47.424261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67134475-9ece-4b79-b147-d78f350a73cb None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:47.424682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67134475-9ece-4b79-b147-d78f350a73cb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:47.424959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67134475-9ece-4b79-b147-d78f350a73cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:47.569456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-67134475-9ece-4b79-b147-d78f350a73cb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:47.571271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-67134475-9ece-4b79-b147-d78f350a73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:47.628798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffc98-8629-4f94-b7db-d2082eed28b4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:47.632768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:47.664472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 391/795] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:47.665782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67134475-9ece-4b79-b147-d78f350a73cb None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:47.688960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:47.689949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:47.691750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:47.692239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:47.719531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:47.721642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:47.757624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:47.758681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:47.759582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:47.759582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:47.759582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:47.763073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 405/796] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:47.773308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:47.863428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:47.875432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67134475-9ece-4b79-b147-d78f350a73cb None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:47.930822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:47.931803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:47.932501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:47.934137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:47.952065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:47.955292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d15bd-2e38-4a23-add3-487e26c13d5a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:47.958124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:47.984880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:47.985888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:47.986814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:47.986814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:47.986814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:47.996451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 392/797] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:47.997230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.019158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.020556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.021054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.022054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.022926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:48.023462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.025877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.041517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 406/798] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:48.043823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.063006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.111806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38549443-5e86-40a5-82e0-f76006dc3917 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.145949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041aae76-f2ed-4673-b118-a8735a9619b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.146630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aae76-f2ed-4673-b118-a8735a9619b7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.146904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aae76-f2ed-4673-b118-a8735a9619b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.147160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aae76-f2ed-4673-b118-a8735a9619b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.155415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a5161-23bc-41d1-9476-0af526213675 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.157236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041aae76-f2ed-4673-b118-a8735a9619b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-041aae76-f2ed-4673-b118-a8735a9619b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:48.162654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:48.163701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:48.164958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 393/799] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:48.165718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862386e6-2e0a-4abd-9615-075b20a6ab6c None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.165718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862386e6-2e0a-4abd-9615-075b20a6ab6c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.165718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862386e6-2e0a-4abd-9615-075b20a6ab6c None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.171392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 394/800] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:48.171392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862386e6-2e0a-4abd-9615-075b20a6ab6c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.177730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.201626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.202239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.202520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.202795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.203427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:48.203732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.205524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.222775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 407/801] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:48.223713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.272449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862386e6-2e0a-4abd-9615-075b20a6ab6c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.306434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.307463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4e7b1-7bee-48a4-bf93-cbe9f3a93bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.308134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e7b1-7bee-48a4-bf93-cbe9f3a93bb4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.308466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e7b1-7bee-48a4-bf93-cbe9f3a93bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.308781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e7b1-7bee-48a4-bf93-cbe9f3a93bb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.315629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4e7b1-7bee-48a4-bf93-cbe9f3a93bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.317099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4e7b1-7bee-48a4-bf93-cbe9f3a93bb4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-b2a4e7b1-7bee-48a4-bf93-cbe9f3a93bb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:48.328994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:48.329889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:48.330833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 395/802] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:48.331890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30ac9-df18-4909-812e-9f4acd9efa63 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.331890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30ac9-df18-4909-812e-9f4acd9efa63 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.332052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30ac9-df18-4909-812e-9f4acd9efa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.338602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be2a0-3b62-405a-bb4d-b0c9809494e7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.350186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4db30ac9-df18-4909-812e-9f4acd9efa63 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:48.351367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4db30ac9-df18-4909-812e-9f4acd9efa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:48.375291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.375990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.376214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.376468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.377152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:48.377421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.378792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.387515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 408/803] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:48.388300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.418896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.436409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 396/804] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:48.436409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db30ac9-df18-4909-812e-9f4acd9efa63 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.494150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f91a7c-2b85-43ba-bfd4-3cb3e2372280 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.538949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.539659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.540021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.540358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.548134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.549688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.551671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:48.563233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:48.564214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:48.565220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:48.568356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db30ac9-df18-4909-812e-9f4acd9efa63 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.568956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 409/805] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:48.569868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.616390 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.617003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.617330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.617601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.618285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:48.618591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.620014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.636415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 397/806] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:48.636415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.690734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e23376-cf7a-4260-b7bd-1047b40678d3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.694707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.729039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78f6d8-3901-4fee-9f33-2beed35e57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.729668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f6d8-3901-4fee-9f33-2beed35e57a4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.729942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f6d8-3901-4fee-9f33-2beed35e57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.730211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f6d8-3901-4fee-9f33-2beed35e57a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.739791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d3710-fbe2-4504-8690-06e6936c0e99 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.740994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78f6d8-3901-4fee-9f33-2beed35e57a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.742434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78f6d8-3901-4fee-9f33-2beed35e57a4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-fa78f6d8-3901-4fee-9f33-2beed35e57a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:48.756952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:48.758073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:48.759182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:48.759182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:48.759182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:48.759182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 410/807] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:48.759182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a682-8f80-407a-be13-6e17f6336b9a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.759548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a682-8f80-407a-be13-6e17f6336b9a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.759893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a682-8f80-407a-be13-6e17f6336b9a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.761073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 411/808] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:48.761620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3a682-8f80-407a-be13-6e17f6336b9a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.777000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.777721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.778098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.778468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.779281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:48.779596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.781058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.797772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 398/809] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:48.798673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.812061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.862345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3a682-8f80-407a-be13-6e17f6336b9a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.895115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.895700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.895977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.896144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955224f-00fc-4e4a-b0b7-a35c6e5b78fb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:48.896612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.897032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:48.897337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.898757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.904313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 412/810] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/role_assignments?user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:48.905109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:48.920894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:48.946225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0e30-aea9-4151-b980-1eab3e648d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:48.946868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0e30-aea9-4151-b980-1eab3e648d86 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.947143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0e30-aea9-4151-b980-1eab3e648d86 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.947414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0e30-aea9-4151-b980-1eab3e648d86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.948007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0e30-aea9-4151-b980-1eab3e648d86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:48.949468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0e30-aea9-4151-b980-1eab3e648d86 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-2d4d0e30-aea9-4151-b980-1eab3e648d86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:48.959781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:48.961073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:48.961917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 399/811] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:48.962725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ea67-f2bd-46b5-b2e0-15b3dcd03343 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:48.962725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ea67-f2bd-46b5-b2e0-15b3dcd03343 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:48.962725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ea67-f2bd-46b5-b2e0-15b3dcd03343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:48.981394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-54b1ea67-f2bd-46b5-b2e0-15b3dcd03343 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:48.982629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-54b1ea67-f2bd-46b5-b2e0-15b3dcd03343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:49.037263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8342c8-aef0-43bc-a562-2676498bebc0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.055042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:49.057806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 400/812] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:49.058950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ea67-f2bd-46b5-b2e0-15b3dcd03343 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.085926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.086594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.086803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.087069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.087705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:49.087998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.089928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.107670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 413/813] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:49.107670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.190386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ea67-f2bd-46b5-b2e0-15b3dcd03343 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.204075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:49.215438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e84da-e7f8-4d49-9f5b-b7af8f12ad29 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.237815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.238679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.239621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.240701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.254157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.254734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.255480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.256419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.256766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.257174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.257522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:49.257974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.259588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.268524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 414/814] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:49.269465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:49.275513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:49.276702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:49.277640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:49.277640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:49.277640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:49.279516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 401/815] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:49.280511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.339097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:49.395886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcfd8-875c-4831-a099-b6384b6fb1fa None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.404228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31463bcc-a0a7-485f-84f9-54ef4a348ef3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.431265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.431866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.432144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.432429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.433052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:49.433350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.434716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.440135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 402/816] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:49.441381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.445459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.446092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.446366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.446634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.454164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.455798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:49.469068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:49.470184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:49.471315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:49.472705 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:49.479576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 415/817] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:49.480750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.559701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e54ddb-eaa2-49cc-9f1e-34e472f21a34 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.587958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:49.593115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e89d0c-df16-48a4-8aea-65b1f1b69db8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.594310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.595189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.596329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.596698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.597414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:49.597805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.599866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.619713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 403/818] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:49.619713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.631472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.632100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.632374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.632696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] PATH_INFO: `/v3/services/network` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.633268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.634636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:49.643255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:49.644338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:49.645855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 416/819] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:49.646763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.708950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:49.729010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede3fcf-597d-47ec-b4d1-18e2b3d87c22 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.751215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ca2de-f0c1-4f04-b1c0-749a2742aa30 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.765115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.765717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.765992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.766260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.766918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.768265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.788025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.788660 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.788942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.789214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.800646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 404/820] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:17:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:49.800855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:49.800855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.801031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.801106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.811770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 417/821] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:49.812796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.836042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:49.922520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2a553-517e-4f70-bee4-8393a441416c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.948761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc0d31-6ad0-43f2-a3ef-34c04d0a8538 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:49.968116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.968578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.968867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.969144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:49.970214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] RBAC: Adding query filter params (name=network) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:49.970311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:49.972766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:49.982232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 418/822] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:49.983701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:49.995169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:49.996114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:49.996661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:49.997126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.008555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.010329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.011214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:50.027034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:50.028207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:50.029205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:50.029644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 405/823] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:50.030132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:50.121042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:50.136513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892b689-9a44-4d2b-9196-0fd02bd7b0fd None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:50.137753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cf134-b88f-46ce-9045-0c26a3a31bec None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:50.180365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:50.180944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.181218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.181484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.185097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:50.185709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.185995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.186265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.186893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] RBAC: Adding query filter params (type=network) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:50.187195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.189749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.193109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.194595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.194795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 406/824] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:17:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:50.195832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:50.212339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:50.213560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:50.214821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:50.214821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:50.214821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:50.214821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 419/825] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:50.214821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:50.282383 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:50.326272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2f895-a391-4685-aff8-9ed48b859f93 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:50.345692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92eb90-ab07-4d18-825e-f29607649c4e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:50.364235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:50.365740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.366316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.366456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.367222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:50.367618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.369357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.388980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 407/826] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:50.390067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:50.391175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:50.391784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.392058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.392327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.393159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.394659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.401555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:50.428410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 420/827] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:17:50 2022] POST /identity/v3/endpoints => generated 337 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:50.428410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:50.592122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dbf87-3d89-4012-9898-039acf876868 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:50.618905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:50.642293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08103-b481-4122-b0a8-1287de60f809 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:50.648302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:50.648598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.648968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.649339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.650113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:50.650511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.651984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.666830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 408/828] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:50.674915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:50.704320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:50.705404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.705835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.706271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/6f2ae343d97d49be9d3d6b430a61a48f/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.709406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=6f2ae343d97d49be9d3d6b430a61a48f, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.711524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.733158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 421/829] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:50 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/6f2ae343d97d49be9d3d6b430a61a48f/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:17:50.817062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419544-26d6-4519-8a88-ff629993ad0a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:50.856923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce431390-8aa7-4611-9b5b-415a3b5338e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:50.857720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce431390-8aa7-4611-9b5b-415a3b5338e9 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.858154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce431390-8aa7-4611-9b5b-415a3b5338e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.858515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce431390-8aa7-4611-9b5b-415a3b5338e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.866993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce431390-8aa7-4611-9b5b-415a3b5338e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:50.868703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce431390-8aa7-4611-9b5b-415a3b5338e9 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-ce431390-8aa7-4611-9b5b-415a3b5338e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:50.884481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:50.885640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:50.886753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:50.892453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 409/830] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:50.893971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:50.950111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:50.980597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b371-1cf3-4731-b4fe-9a22cba23acf None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.981462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b371-1cf3-4731-b4fe-9a22cba23acf None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.981975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b371-1cf3-4731-b4fe-9a22cba23acf None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:50.983849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 410/831] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:17:50.989172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65aa93-a6ba-4afc-9171-2a559584bc8c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:50.989623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65aa93-a6ba-4afc-9171-2a559584bc8c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:50.990190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65aa93-a6ba-4afc-9171-2a559584bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.005651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9642b90-57c5-47e7-b707-3005e36031f8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:51.009581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-bb65aa93-a6ba-4afc-9171-2a559584bc8c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:51.010979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bb65aa93-a6ba-4afc-9171-2a559584bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:51.041606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:51.042220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:51.042499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:51.042768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.043457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:51.043764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:51.045222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:51.047574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:51.058220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 422/832] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:51.063982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:51.097294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 411/833] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:51.169905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966da75-3aaa-46d7-91a7-bbfebfbb1b67 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:51.179351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:51.205235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:51.205889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:51.206169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:51.206441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/b65fda206995485db38858538d48a176/roles/80e9dd6f85584a769f314f6f052c4cc2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.221099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=b65fda206995485db38858538d48a176, role_id=80e9dd6f85584a769f314f6f052c4cc2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:51.222539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:51.238320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 423/834] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:17:51 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/b65fda206995485db38858538d48a176/roles/80e9dd6f85584a769f314f6f052c4cc2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:17:51.390323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65aa93-a6ba-4afc-9171-2a559584bc8c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:51.496425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65aa93-a6ba-4afc-9171-2a559584bc8c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:51.537916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:51.538607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:51.538886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:51.539154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.539734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:51.541125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:51.549996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:51.550943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:51.551860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 412/835] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Sep 1 00:17:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:51.559590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:51.672698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fafa6-e4a9-4edf-9be2-c773e3a3197b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:51.709806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92071f76-7895-4d1c-9c12-e31974435c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:51.710824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071f76-7895-4d1c-9c12-e31974435c6b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:51.711371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071f76-7895-4d1c-9c12-e31974435c6b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:51.711874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071f76-7895-4d1c-9c12-e31974435c6b None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.712735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92071f76-7895-4d1c-9c12-e31974435c6b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:51.713245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92071f76-7895-4d1c-9c12-e31974435c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:51.714819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92071f76-7895-4d1c-9c12-e31974435c6b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:51.719952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 424/836] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:17:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:51.725854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:51.763895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:51.831522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a3f0-f6df-4f6f-9243-1172af0755f2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:51.866949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1be6f1-f411-412d-b629-4f617bd9ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:51.867582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be6f1-f411-412d-b629-4f617bd9ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:51.867860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be6f1-f411-412d-b629-4f617bd9ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:51.868133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be6f1-f411-412d-b629-4f617bd9ffa6 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.868811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1be6f1-f411-412d-b629-4f617bd9ffa6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:51.869113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1be6f1-f411-412d-b629-4f617bd9ffa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:51.870534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1be6f1-f411-412d-b629-4f617bd9ffa6 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:51.877327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 413/837] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:17:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:51.924289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fffbd-2c35-44e7-96fb-89f0ab410fbe None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:51.924499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fffbd-2c35-44e7-96fb-89f0ab410fbe None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:51.924778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fffbd-2c35-44e7-96fb-89f0ab410fbe None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.926412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 425/838] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:51.932075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135103f-983c-4c7c-926f-08d91028d15b None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:51.932667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135103f-983c-4c7c-926f-08d91028d15b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:51.933101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135103f-983c-4c7c-926f-08d91028d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:51.952913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-3135103f-983c-4c7c-926f-08d91028d15b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:51.954984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3135103f-983c-4c7c-926f-08d91028d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:52.027459 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 414/839] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:52.293880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fffbd-2c35-44e7-96fb-89f0ab410fbe None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:52.319983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:52.403240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fffbd-2c35-44e7-96fb-89f0ab410fbe None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:52.440231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:52.441301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:52.441804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:52.442271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:52.443233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:52.444877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:52.454482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:52.455482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:17:52.456352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:52.459744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 426/840] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:52.465683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135103f-983c-4c7c-926f-08d91028d15b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:52.490745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:52.567584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135103f-983c-4c7c-926f-08d91028d15b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:52.603667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8683247-0589-42d5-8bd5-678f68047807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:52.604274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683247-0589-42d5-8bd5-678f68047807 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:52.604577 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683247-0589-42d5-8bd5-678f68047807 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:52.604842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683247-0589-42d5-8bd5-678f68047807 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:52.605457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8683247-0589-42d5-8bd5-678f68047807 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:52.605751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8683247-0589-42d5-8bd5-678f68047807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:52.607098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8683247-0589-42d5-8bd5-678f68047807 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:52.612028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 415/841] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:52.617713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:52.704649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:52.713828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9f79-0464-4396-8be7-aa593586113a None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:52.714457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9f79-0464-4396-8be7-aa593586113a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:52.714742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9f79-0464-4396-8be7-aa593586113a None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:52.720479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 416/842] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:17:52.722276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565db42d-1b25-4a0f-841b-8701f1c298ed None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:52.722560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565db42d-1b25-4a0f-841b-8701f1c298ed None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:52.722835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565db42d-1b25-4a0f-841b-8701f1c298ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:52.723101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99118287-8f3f-4859-9906-8f6a96318b09 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:52.745337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-565db42d-1b25-4a0f-841b-8701f1c298ed None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:52.746951 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-565db42d-1b25-4a0f-841b-8701f1c298ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:52.763401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:52.764252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:52.764578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:52.765287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:52.766176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:52.766488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:52.768112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:52.774579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 427/843] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:52.832648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 417/844] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:17:53.105147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:53.209478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab686-3405-4d18-a30c-f6503079f76c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:53.244659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9627a9-2639-4696-9caf-994a119afcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:53.245288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9627a9-2639-4696-9caf-994a119afcdd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.245568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9627a9-2639-4696-9caf-994a119afcdd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.245844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9627a9-2639-4696-9caf-994a119afcdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.256691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9627a9-2639-4696-9caf-994a119afcdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5b9627a9-2639-4696-9caf-994a119afcdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:53.261984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:53.264163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:17:53.266200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:53.268423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 428/845] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:53.269836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565db42d-1b25-4a0f-841b-8701f1c298ed None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:53.291622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:53.309674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c07f-c39e-4ec3-8e36-0bb7cd2fc85f None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.310193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c07f-c39e-4ec3-8e36-0bb7cd2fc85f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.310583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c07f-c39e-4ec3-8e36-0bb7cd2fc85f None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.312264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 429/846] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:17:53.317761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a1ab3-f015-4d81-bd4c-fa5185b7bdef None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.318205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a1ab3-f015-4d81-bd4c-fa5185b7bdef None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.318573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a1ab3-f015-4d81-bd4c-fa5185b7bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.336549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2a2a1ab3-f015-4d81-bd4c-fa5185b7bdef None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:53.337929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2a2a1ab3-f015-4d81-bd4c-fa5185b7bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:53.347209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:53.388952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565db42d-1b25-4a0f-841b-8701f1c298ed None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:53.427106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:53.427721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 430/847] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:17:53.427849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.428107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.428374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.429067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:53.429366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:53.430727 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:53.439512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 418/848] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:53.446581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a1ab3-f015-4d81-bd4c-fa5185b7bdef None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:53.551400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a1ab3-f015-4d81-bd4c-fa5185b7bdef None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:53.588072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:53.588736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.589019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.589292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.600105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:53.601587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:53.608678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:53.617494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:53.618906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:53.619823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:53.619823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:53.619823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:53.623603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 431/849] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:53.624971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:53.704125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:53.712071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:53.737310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d12f8-bd08-4ecd-84a3-b0a9db9cdf1f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:53.781956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:53.782849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.783128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.783466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.784288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:53.784951 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:53.786652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:53.802949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 419/850] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:53.808650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:53.836794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb529-cfef-4b93-8920-30fd5ba5e2d2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:53.873028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8423630-d029-48da-bbd2-777f8349d0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:53.873663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423630-d029-48da-bbd2-777f8349d0db None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.873948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423630-d029-48da-bbd2-777f8349d0db None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.874220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423630-d029-48da-bbd2-777f8349d0db None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.885168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8423630-d029-48da-bbd2-777f8349d0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b8423630-d029-48da-bbd2-777f8349d0db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:53.891645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:53.894416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:53.897784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 432/851] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:17:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:53.900146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e7ede-a206-499a-8f7e-38fb9d6d0d79 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.900448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e7ede-a206-499a-8f7e-38fb9d6d0d79 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.900723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e7ede-a206-499a-8f7e-38fb9d6d0d79 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.904411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 433/852] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:53.904411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e7ede-a206-499a-8f7e-38fb9d6d0d79 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:53.921367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479de9-0bbe-4828-8029-b82f7012b917 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:53.956514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6849ce-13f0-452d-b572-ec4ccea236c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:53.957046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6849ce-13f0-452d-b572-ec4ccea236c3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.957315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6849ce-13f0-452d-b572-ec4ccea236c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.957576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6849ce-13f0-452d-b572-ec4ccea236c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:53.963300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:53.965702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6849ce-13f0-452d-b572-ec4ccea236c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:53.967147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6849ce-13f0-452d-b572-ec4ccea236c3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:53.969909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-ee6849ce-13f0-452d-b572-ec4ccea236c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:53.980013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:53.981006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 00:17:53.981967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:53.985862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 420/853] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:17:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:53.986901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b8558-74db-4cab-996d-907a686a4c8b None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:53.987309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b8558-74db-4cab-996d-907a686a4c8b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:53.987581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b8558-74db-4cab-996d-907a686a4c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.005356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f56b8558-74db-4cab-996d-907a686a4c8b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:54.006712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f56b8558-74db-4cab-996d-907a686a4c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:54.020061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e7ede-a206-499a-8f7e-38fb9d6d0d79 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.062777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.063704 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.064258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.064555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.065368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:54.065676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.067654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.080482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 421/854] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:54.080482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b8558-74db-4cab-996d-907a686a4c8b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.088528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 434/855] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:17:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:54.091600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.204864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05294d7-dcfe-4df7-9853-d084f103c247 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.206835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b8558-74db-4cab-996d-907a686a4c8b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.219921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:54.243350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.244223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:54.244938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.245212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.245474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.253037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.253637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.253913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.254191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.255885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:54.256193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.258076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.259630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.262851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.282924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 422/856] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:54.283419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:54.284331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:54.285276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:54.285276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:54.285276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:54.288449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 435/857] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:54.289781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.289888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.407993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbd1f9-822c-4f7c-957b-8704345d502b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.412918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3d2a-0e66-4b4a-b194-568463bffed0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.444149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.444824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.445129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.445456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.448281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.448916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.449192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.449463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.450106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:54.450405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.451778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.464751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 436/858] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:54.469795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.497327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:54.507635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:54.523578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.523578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.578077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3c5f-8b72-4f9b-ae14-5eeb72ca938e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.613652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.614251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.614526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.614845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.615500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.616899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.631056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 423/859] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:17:54.632167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.640596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 437/860] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:17:54 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:54.643146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.744003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:54.746124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:54.763828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d672d27-8ab9-41d6-8836-2791e84db169 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.771812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528822-5a9f-4aa3-b979-1a16dcc7855b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.808690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08975df6-886e-423c-bc04-7f367251cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.809328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08975df6-886e-423c-bc04-7f367251cf8a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.809605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08975df6-886e-423c-bc04-7f367251cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.809873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08975df6-886e-423c-bc04-7f367251cf8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.811389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e498b2-d2ea-4bfd-b0cd-4923bcb4add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.812035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e498b2-d2ea-4bfd-b0cd-4923bcb4add1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.812313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e498b2-d2ea-4bfd-b0cd-4923bcb4add1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.812638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e498b2-d2ea-4bfd-b0cd-4923bcb4add1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.820706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08975df6-886e-423c-bc04-7f367251cf8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.822171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08975df6-886e-423c-bc04-7f367251cf8a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.824645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e498b2-d2ea-4bfd-b0cd-4923bcb4add1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.826097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e498b2-d2ea-4bfd-b0cd-4923bcb4add1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-08975df6-886e-423c-bc04-7f367251cf8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:54.836400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:54.837373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:54.838344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 424/861] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:54.838954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42158e0-8889-49f4-b1b5-edb115f9856d None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.838954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42158e0-8889-49f4-b1b5-edb115f9856d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.839223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42158e0-8889-49f4-b1b5-edb115f9856d None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.840679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 425/862] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:54.843182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42158e0-8889-49f4-b1b5-edb115f9856d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-32e498b2-d2ea-4bfd-b0cd-4923bcb4add1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:54.845393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:54.846652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:54.848088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:54.848088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:54.848088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:54.848088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 438/863] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:54.848088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323412b-09d2-4b49-b6b4-0939bb71155d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.848508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323412b-09d2-4b49-b6b4-0939bb71155d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.848508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323412b-09d2-4b49-b6b4-0939bb71155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.868169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e323412b-09d2-4b49-b6b4-0939bb71155d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:54.869799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e323412b-09d2-4b49-b6b4-0939bb71155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:54.944502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 439/864] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:54.944502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323412b-09d2-4b49-b6b4-0939bb71155d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:54.956271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42158e0-8889-49f4-b1b5-edb115f9856d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:54.993776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:54.994444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:54.994661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:54.994935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:54.995650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:54.995949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:54.997397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.017648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 426/865] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:55.022905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.031971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:55.033429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:55.093686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323412b-09d2-4b49-b6b4-0939bb71155d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.137901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.138550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.138831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.139105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.139749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:55.140052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.141501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.142276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397caa8d-7140-4cde-9037-4134cf01bbc2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.161216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 440/866] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:55.162645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.188586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.190093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.190659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.191082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.270504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23f44c-1e10-4a57-99e9-76cfcaa3f9d1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.272698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.274148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.281852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:55.293999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:55.306014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.306671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.306951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.307220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.313892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.315351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:55.329717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:55.330813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 441/867] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:55.331728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.398980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 427/868] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:17:55 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:17:55.399998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.438178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734d24-eed4-447b-a385-03aecd8e2827 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.473486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.474513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.474797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.475071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.476076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.477835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.494160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 442/869] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:17:55 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:17:55.495498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.516779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88ce4b-6920-46e9-8dc6-50aa953eb001 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.526095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:55.565710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:55.567506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.568115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.568713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.569178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.570596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:55.571006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.574002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.594026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 428/870] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:55.595838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.648412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989266bf-1a86-4258-949f-8ffe8cf90104 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.682631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.683280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.683558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.683833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.695368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.697027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:55.715794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:55.716838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:55.717741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:55.717741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:55.717741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:55.717741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 443/871] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:55.722035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b804a6-b2bc-4372-8177-839d083a1df1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.722673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.769800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.770754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.771308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.771722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.772723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=6f2ae343d97d49be9d3d6b430a61a48f) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:55.773207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.774886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.782080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 429/872] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:55 2022] GET /identity/v3/role_assignments?user.id=6f2ae343d97d49be9d3d6b430a61a48f&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:55.842893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:55.850267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823052b6-d40c-449d-94de-b8382fb6706c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:55.888439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:55.889071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:55.889352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:55.889626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:55.890279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:55.890582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:55.891984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:55.906191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 444/873] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:55.911111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:55.951650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:56.026251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c719359-d72d-4462-bab4-c9ad99c1b1fa None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:56.064185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:56.064768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:56.065046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:56.065377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:56.072430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:56.073893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:17:56.086213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:56.087286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:56.088196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 430/874] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:56.094910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:56.201581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b6e1-7a28-4d8c-b4de-f91aac52041d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:56.241970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604218f-294b-4ba5-9228-24cb9c0395ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:56.242577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604218f-294b-4ba5-9228-24cb9c0395ff None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:56.242856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604218f-294b-4ba5-9228-24cb9c0395ff None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:56.243128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604218f-294b-4ba5-9228-24cb9c0395ff None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:56.243821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604218f-294b-4ba5-9228-24cb9c0395ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:56.244124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604218f-294b-4ba5-9228-24cb9c0395ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:56.245602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604218f-294b-4ba5-9228-24cb9c0395ff None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:56.257713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 445/875] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:17:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:56.265456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:56.355603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:56.374345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c10f6-d3f9-4b07-bc72-21a0abde8af1 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:56.409465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3161c3-bb7f-48c5-9dd6-948e3d080653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:56.410227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3161c3-bb7f-48c5-9dd6-948e3d080653 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:56.410607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3161c3-bb7f-48c5-9dd6-948e3d080653 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:56.410980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3161c3-bb7f-48c5-9dd6-948e3d080653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:56.412329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3161c3-bb7f-48c5-9dd6-948e3d080653 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=b65fda206995485db38858538d48a176) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:56.412765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3161c3-bb7f-48c5-9dd6-948e3d080653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:56.414351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3161c3-bb7f-48c5-9dd6-948e3d080653 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:56.421177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 431/876] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:17:56 2022] GET /identity/v3/role_assignments?user.id=b65fda206995485db38858538d48a176&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:56.618706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9bfc5-6b1b-4e6c-91a6-16b52ab5aff8 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:56.619036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9bfc5-6b1b-4e6c-91a6-16b52ab5aff8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:56.619201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9bfc5-6b1b-4e6c-91a6-16b52ab5aff8 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:56.620678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 446/877] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:56.625886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76e0c7-2e24-4257-b463-797d870deee2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:56.626394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76e0c7-2e24-4257-b463-797d870deee2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:56.626879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76e0c7-2e24-4257-b463-797d870deee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:56.646385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6e76e0c7-2e24-4257-b463-797d870deee2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:56.647791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6e76e0c7-2e24-4257-b463-797d870deee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:56.717318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 432/878] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:56.983141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9bfc5-6b1b-4e6c-91a6-16b52ab5aff8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:57.004350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:57.093306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9bfc5-6b1b-4e6c-91a6-16b52ab5aff8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:57.128780 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:57.129649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.130080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.131054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.131782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:57.133335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:57.142443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:57.143576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:17:57.144665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:57.145676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 447/879] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Sep 1 00:17:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:57.153794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76e0c7-2e24-4257-b463-797d870deee2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:57.233620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:57.252524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76e0c7-2e24-4257-b463-797d870deee2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:57.292465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:57.293463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.293946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.294419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.295248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:57.295783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:57.297408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:57.302704 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 433/880] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:17:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:57.311270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:57.390842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:57.410426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eed07-3ed1-4cdb-b95c-96a7e2179dea None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:57.445805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5842-52d5-4fe4-ae5a-a3c187bec708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:57.446470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5842-52d5-4fe4-ae5a-a3c187bec708 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.446749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5842-52d5-4fe4-ae5a-a3c187bec708 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.447063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5842-52d5-4fe4-ae5a-a3c187bec708 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.447690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf5842-52d5-4fe4-ae5a-a3c187bec708 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:57.447986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf5842-52d5-4fe4-ae5a-a3c187bec708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:57.449375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf5842-52d5-4fe4-ae5a-a3c187bec708 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:57.454465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 448/881] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:17:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:57.460841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:57.535701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce0ea-195c-4739-946f-d3dff18741b4 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.536289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce0ea-195c-4739-946f-d3dff18741b4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.536858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce0ea-195c-4739-946f-d3dff18741b4 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.538655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 449/882] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:57.543935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0687dfc-3396-4f9d-9b49-92f402276aba None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.544489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0687dfc-3396-4f9d-9b49-92f402276aba None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.545046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0687dfc-3396-4f9d-9b49-92f402276aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.564015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a0687dfc-3396-4f9d-9b49-92f402276aba None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:57.565651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765fd98-0b13-4071-945c-26babac396fe None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:57.565771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a0687dfc-3396-4f9d-9b49-92f402276aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:57.609177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:57.609783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.610062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.610337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.611405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] RBAC: Adding query filter params (interface=public, service_id=920f5493e9f44bdd877ac43c47b31d77, region_id=RegionOne) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:57.611718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:57.613446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:57.620909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 434/883] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:17:57 2022] GET /identity/v3/endpoints?service_id=920f5493e9f44bdd877ac43c47b31d77&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:57.633356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:57.639125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 450/884] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:17:57.648732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:57.741586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea954-2ac4-425a-8c7d-3cde7c4843bd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:57.776847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265984-e40c-48b8-b52a-76c1fbbf2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:57.777377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265984-e40c-48b8-b52a-76c1fbbf2c06 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.777657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265984-e40c-48b8-b52a-76c1fbbf2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.777928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265984-e40c-48b8-b52a-76c1fbbf2c06 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.778527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265984-e40c-48b8-b52a-76c1fbbf2c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:57.779896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265984-e40c-48b8-b52a-76c1fbbf2c06 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:57.786060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 435/885] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:17:57 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:17:57.893026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f628-db6a-4ff2-8de0-e6af9ccc124f None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.893626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f628-db6a-4ff2-8de0-e6af9ccc124f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.894153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f628-db6a-4ff2-8de0-e6af9ccc124f None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.895980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 451/886] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:57.901299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f743-deb5-4e80-8bdc-f5052169f5f0 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:57.901573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f743-deb5-4e80-8bdc-f5052169f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:57.901845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f743-deb5-4e80-8bdc-f5052169f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:57.916944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f628-db6a-4ff2-8de0-e6af9ccc124f None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:57.922660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0ca8f743-deb5-4e80-8bdc-f5052169f5f0 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:57.923875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0ca8f743-deb5-4e80-8bdc-f5052169f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:58.007834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:58.012326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 436/887] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:58.045791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34f628-db6a-4ff2-8de0-e6af9ccc124f None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.084493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.085475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.086046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.086542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.087369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.089025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:58.098730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:58.100358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:17:58.101239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:58.104256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 452/888] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:17:58.112374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8f743-deb5-4e80-8bdc-f5052169f5f0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:58.113013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:58.214049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8f743-deb5-4e80-8bdc-f5052169f5f0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.250125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.250726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.251003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.251271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.251896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:58.252197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.253618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.258774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 437/889] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:58.264401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:58.300795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:58.370706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:58.378655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a38ef3-0d98-4198-8b0b-2cd3e0685146 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.409296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82af18-b4a7-4e9f-8c1b-fc67e0a33148 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.417734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.418721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.419211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.419692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.420699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:58.421224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.422912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.429610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 453/890] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:17:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:58.434986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:58.438202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:58.453539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.454407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.454752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.455095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.455750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.458111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:58.471244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:58.477832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:17:58.478967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 438/891] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:17:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:58.479781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:58.558959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c38d-b367-47fa-b429-98667a967ff1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.594802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de09f6-0f3d-4424-ad18-9b6c36f038ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.595411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de09f6-0f3d-4424-ad18-9b6c36f038ab None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.595688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de09f6-0f3d-4424-ad18-9b6c36f038ab None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.595961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de09f6-0f3d-4424-ad18-9b6c36f038ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.596683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de09f6-0f3d-4424-ad18-9b6c36f038ab None admin] RBAC: Adding query filter params (interface=public, service_id=a5812a2ed990491f9ba0d1bcca6042c0, region_id=RegionOne) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:58.596987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de09f6-0f3d-4424-ad18-9b6c36f038ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.598350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de09f6-0f3d-4424-ad18-9b6c36f038ab None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.602501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed266-2d86-4efb-90ba-5a04735585cb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.606471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 454/892] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:17:58 2022] GET /identity/v3/endpoints?service_id=a5812a2ed990491f9ba0d1bcca6042c0&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:17:58.607700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad992-fc15-4121-91d7-b606793b92ee None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.607983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad992-fc15-4121-91d7-b606793b92ee None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.608254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad992-fc15-4121-91d7-b606793b92ee None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.613706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 455/893] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:58.614392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad992-fc15-4121-91d7-b606793b92ee None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:58.635817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:58.643871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c49b8-8a34-406d-b4fc-b87bd0a2006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.644583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c49b8-8a34-406d-b4fc-b87bd0a2006e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.644906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c49b8-8a34-406d-b4fc-b87bd0a2006e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.645197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c49b8-8a34-406d-b4fc-b87bd0a2006e None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.645774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c49b8-8a34-406d-b4fc-b87bd0a2006e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:58.646076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c49b8-8a34-406d-b4fc-b87bd0a2006e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.647437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c49b8-8a34-406d-b4fc-b87bd0a2006e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.656494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 439/894] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:17:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:58.656494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93961db-c148-46b4-b28f-59a5dd76e734 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.656494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93961db-c148-46b4-b28f-59a5dd76e734 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.656494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93961db-c148-46b4-b28f-59a5dd76e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.673270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e93961db-c148-46b4-b28f-59a5dd76e734 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:58.674451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e93961db-c148-46b4-b28f-59a5dd76e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:58.690790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:58.733831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad992-fc15-4121-91d7-b606793b92ee None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.746016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 440/895] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:17:58.753489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93961db-c148-46b4-b28f-59a5dd76e734 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:58.773390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.774002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.774284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.774555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.775217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.776736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.793113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 456/896] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:17:58 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:17:58.882204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93961db-c148-46b4-b28f-59a5dd76e734 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:58.909932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:58.922952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:58.923622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:58.923940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:58.924208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:58.924877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:58.925178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:58.926572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:58.932017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 441/897] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:17:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:59.015966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:59.127594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654bea-a240-4090-b188-b49ffa2a91d1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:59.157556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:59.163705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:59.164933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:59.165567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:59.166212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:59.177503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:17:59.182866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:59.183828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:59.184902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 457/898] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Sep 1 00:17:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:59.191900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:59.301002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054d807-6d6a-4985-97df-f021a3ce398b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:59.338213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:59.338824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:59.339106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:59.339376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:59.340037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:59.340335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:59.341737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:59.351356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 442/899] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Sep 1 00:17:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:59.357381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:59.464567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f546036-63bc-4920-aee4-977e0b78c120 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:59.503486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:59.504134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:59.504440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:59.504719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:59.520005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:59.521595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:17:59.537110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:59.538065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:17:59.539355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:17:59.539355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:17:59.539355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:59.539355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 458/900] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:59.545632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:59.596681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:59.655454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce137dcc-0f02-409b-ad72-6c2b9344a7f0 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:59.691346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81441974-dd61-4e40-98e2-9cd5839ae64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:59.692305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81441974-dd61-4e40-98e2-9cd5839ae64e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:59.693371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81441974-dd61-4e40-98e2-9cd5839ae64e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:59.693927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81441974-dd61-4e40-98e2-9cd5839ae64e None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:59.694805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81441974-dd61-4e40-98e2-9cd5839ae64e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:17:59.695303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81441974-dd61-4e40-98e2-9cd5839ae64e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:59.696904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81441974-dd61-4e40-98e2-9cd5839ae64e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:59.709541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 443/901] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:17:59.720472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:59.765473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:17:59.785853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645212-932c-47a0-92cc-bdf870696d76 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:59.786648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645212-932c-47a0-92cc-bdf870696d76 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:59.787120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645212-932c-47a0-92cc-bdf870696d76 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:59.789020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 444/902] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:17:59.794893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40cc4-1938-4d11-9bf2-4e9e8b7e0f0c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:59.795399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40cc4-1938-4d11-9bf2-4e9e8b7e0f0c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:59.795862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40cc4-1938-4d11-9bf2-4e9e8b7e0f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:59.814443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6ed40cc4-1938-4d11-9bf2-4e9e8b7e0f0c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:17:59.815940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6ed40cc4-1938-4d11-9bf2-4e9e8b7e0f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:17:59.827394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfe04-10c5-4a06-b156-fb73587ff143 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:17:59.866058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:17:59.866688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:17:59.866970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:17:59.867245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:17:59.879098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:17:59.880880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:17:59.893320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:17:59.894302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:17:59.895426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 459/903] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:17:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:17:59.902058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:17:59.902300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 445/904] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:17:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:00.014100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9d578-dc75-4f56-9d31-0dfb2b69e0ab None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.015530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.050170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.050939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.051099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.051287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.052614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:00.052919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.054396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.072158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 460/905] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Sep 1 00:17:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:00.077562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed40cc4-1938-4d11-9bf2-4e9e8b7e0f0c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.125600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.166483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.196941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed40cc4-1938-4d11-9bf2-4e9e8b7e0f0c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.233289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.233947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.234224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.234494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.299970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42871f6a-6c7b-46b3-8451-11c2e2ebfcf4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.305171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.306630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.345893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.347393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.347873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.348619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.349598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.349773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.351126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:00.372820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:00.373826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 00:18:00.374728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:00.379108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 461/906] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Sep 1 00:18:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:00.380005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.413984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.440415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 446/907] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:00 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:00.446635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.525420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da858b-6081-4e21-87c6-d7800aaba7e3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.563885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.564849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.565330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.565779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.566673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1757-f7f8-46f7-b125-20a7e3ddf081 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.567141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:00.567685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.569531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.579686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 462/908] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:18:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:00.580854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.610334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.611121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.611403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.611678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.625136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.630959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.632458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:00.648839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:00.649867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:00.650804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:00.650804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:00.650804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:00.654931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 447/909] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:00.655831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.698893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.717869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5e81e-2970-4408-8aef-b6a27f0f5bcf None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.757176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.758185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.758767 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.759246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.760088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:00.760739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.762546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.764132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1c7a4-1b61-436c-a4a1-64787a6aad0b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.768579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 463/910] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:18:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:00.774162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.811773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba0e0-6821-4050-b1b9-dbcf7997f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.813415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba0e0-6821-4050-b1b9-dbcf7997f306 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.814118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba0e0-6821-4050-b1b9-dbcf7997f306 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.814657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba0e0-6821-4050-b1b9-dbcf7997f306 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.815454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba0e0-6821-4050-b1b9-dbcf7997f306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:00.815905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba0e0-6821-4050-b1b9-dbcf7997f306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.818524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba0e0-6821-4050-b1b9-dbcf7997f306 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.830727 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 448/911] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:00.832350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee57c4-4e2b-4cb9-a63e-c8d35390b36f None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.832659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee57c4-4e2b-4cb9-a63e-c8d35390b36f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.832931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee57c4-4e2b-4cb9-a63e-c8d35390b36f None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.834283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 449/912] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:00.838740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee57c4-4e2b-4cb9-a63e-c8d35390b36f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:00.896021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.901095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431573-e42d-44d3-a0dd-6dd895830401 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.937836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcd3c6-3d5a-4423-aa7c-d6aab1d10046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.938441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcd3c6-3d5a-4423-aa7c-d6aab1d10046 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.938725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcd3c6-3d5a-4423-aa7c-d6aab1d10046 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.939173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcd3c6-3d5a-4423-aa7c-d6aab1d10046 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.939645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcd3c6-3d5a-4423-aa7c-d6aab1d10046 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:00.941176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcd3c6-3d5a-4423-aa7c-d6aab1d10046 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:00.949500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee57c4-4e2b-4cb9-a63e-c8d35390b36f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:00.963314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 464/913] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:18:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:18:00.964626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c790b64-2a54-47fd-9da0-37fdb7a8efaf None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.964910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c790b64-2a54-47fd-9da0-37fdb7a8efaf None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.965182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c790b64-2a54-47fd-9da0-37fdb7a8efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:00.984700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0c790b64-2a54-47fd-9da0-37fdb7a8efaf None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:00.985929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0c790b64-2a54-47fd-9da0-37fdb7a8efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:00.988648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:00.997025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15822b26-c061-41db-9323-b270801e3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:00.998530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15822b26-c061-41db-9323-b270801e3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:00.998961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15822b26-c061-41db-9323-b270801e3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:00.999424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15822b26-c061-41db-9323-b270801e3cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.009863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15822b26-c061-41db-9323-b270801e3cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:01.011356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15822b26-c061-41db-9323-b270801e3cc1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-15822b26-c061-41db-9323-b270801e3cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:18:01.024470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:01.025495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:01.026431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 450/914] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:01.026929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c056-d7b7-4870-91bd-e9e7b5f4ad23 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.026929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c056-d7b7-4870-91bd-e9e7b5f4ad23 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.027604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c056-d7b7-4870-91bd-e9e7b5f4ad23 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.028689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 451/915] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:01.034042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4c056-d7b7-4870-91bd-e9e7b5f4ad23 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:01.073220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 465/916] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:01.074715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a236c-1324-4c98-8ffd-dffa4279433d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.075216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a236c-1324-4c98-8ffd-dffa4279433d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.075588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a236c-1324-4c98-8ffd-dffa4279433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.105038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-116a236c-1324-4c98-8ffd-dffa4279433d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:01.107811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-116a236c-1324-4c98-8ffd-dffa4279433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:01.178311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4c056-d7b7-4870-91bd-e9e7b5f4ad23 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:01.188429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:01.201007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 466/917] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:01.221104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:01.221924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.222348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.222834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.223680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:01.224209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:01.225858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:01.239150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 452/918] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:01.245962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a236c-1324-4c98-8ffd-dffa4279433d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:01.317882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:01.348311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:01.354175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a236c-1324-4c98-8ffd-dffa4279433d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:01.388841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:01.389447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.389728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.390001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.390734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] RBAC: Adding query filter params (role.id=da03f118f51c4e86874b9270563bfeb4, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=b65fda206995485db38858538d48a176) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:01.391045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:01.392500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:01.398837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 467/919] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:01 2022] GET /identity/v3/role_assignments?user.id=b65fda206995485db38858538d48a176&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=da03f118f51c4e86874b9270563bfeb4 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:01.460871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297fbb2-cf53-4f82-85b2-9758f2f2ff8c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:01.472802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:01.500422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:01.501245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.501634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.501904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.502559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:01.504072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:01.517617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:01.518689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:01.519565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 453/920] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:18:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:01.528433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:01.564178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:01.590177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddef45f-edca-436e-adde-08e24ca88c16 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:01.621097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:01.627469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:01.628079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.628354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.628651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.629310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:01.631471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:01.644508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b604-50e1-43a6-8654-a3421e493388 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:01.656670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 468/921] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:18:01 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:18:01.697609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:01.698671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.699242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.699713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.700732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:01.701247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:01.703058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:01.710239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 454/922] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:18:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:01.716358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:01.829791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2c792-725a-4624-b72a-9fc8b9984361 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:01.865876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83779cfc-7c05-4471-8a01-e849c62a8abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:01.866874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83779cfc-7c05-4471-8a01-e849c62a8abd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:01.867358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83779cfc-7c05-4471-8a01-e849c62a8abd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:01.867847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83779cfc-7c05-4471-8a01-e849c62a8abd None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:01.868766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83779cfc-7c05-4471-8a01-e849c62a8abd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:01.869272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83779cfc-7c05-4471-8a01-e849c62a8abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:01.870836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83779cfc-7c05-4471-8a01-e849c62a8abd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:01.876329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 469/923] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Sep 1 00:18:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:01.882695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:01.980649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:01.991329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3869210-0082-4f4b-82e0-ba095522d415 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:02.027580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df1503-d8ff-4358-b1e0-fa5082167882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:02.028571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1503-d8ff-4358-b1e0-fa5082167882 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:02.029051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1503-d8ff-4358-b1e0-fa5082167882 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:02.029544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1503-d8ff-4358-b1e0-fa5082167882 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:02.030409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df1503-d8ff-4358-b1e0-fa5082167882 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:02.032037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df1503-d8ff-4358-b1e0-fa5082167882 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:02.055291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 455/924] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:18:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:18:02.991752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743e62-9208-4020-8078-b742bbdd21e7 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:02.992303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743e62-9208-4020-8078-b742bbdd21e7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:02.992303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743e62-9208-4020-8078-b742bbdd21e7 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:02.993937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 470/925] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:02.998997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1067ca-6964-403c-9658-63b0492d9a41 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:02.999391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1067ca-6964-403c-9658-63b0492d9a41 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:02.999576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1067ca-6964-403c-9658-63b0492d9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.018069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4e1067ca-6964-403c-9658-63b0492d9a41 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:03.019254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4e1067ca-6964-403c-9658-63b0492d9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:03.102411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 456/926] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:03.366500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb06a-2a20-4720-ab59-ed43012558e7 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.366694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb06a-2a20-4720-ab59-ed43012558e7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.366974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb06a-2a20-4720-ab59-ed43012558e7 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.368563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 471/927] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:03.370724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1067ca-6964-403c-9658-63b0492d9a41 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:03.373373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d371-b1e8-43e9-a951-e204fad2dace None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.373655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d371-b1e8-43e9-a951-e204fad2dace None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.373925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d371-b1e8-43e9-a951-e204fad2dace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.392763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c506d371-b1e8-43e9-a951-e204fad2dace None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:03.393969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c506d371-b1e8-43e9-a951-e204fad2dace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:03.454017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:03.454872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:03.484628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1067ca-6964-403c-9658-63b0492d9a41 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:03.492475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 472/928] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:03.527255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c91a-7453-49ec-9cf1-8d13487fc37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:03.527898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c91a-7453-49ec-9cf1-8d13487fc37d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.528176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c91a-7453-49ec-9cf1-8d13487fc37d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.528477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c91a-7453-49ec-9cf1-8d13487fc37d None admin] PATH_INFO: `/v3/services/compute` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.529061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307c91a-7453-49ec-9cf1-8d13487fc37d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:03.530438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307c91a-7453-49ec-9cf1-8d13487fc37d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-6307c91a-7453-49ec-9cf1-8d13487fc37d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:03.539640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:03.540668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:03.541573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 457/929] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:03.546851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506d371-b1e8-43e9-a951-e204fad2dace None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:03.598530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946700-e168-44dd-a102-66f6efca1430 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.598940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946700-e168-44dd-a102-66f6efca1430 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.599133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946700-e168-44dd-a102-66f6efca1430 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.600849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 458/930] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:03.609578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59cab-561f-44b1-a14c-13e1e117e552 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.610013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59cab-561f-44b1-a14c-13e1e117e552 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.610443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59cab-561f-44b1-a14c-13e1e117e552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.630354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-9ae59cab-561f-44b1-a14c-13e1e117e552 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:03.631611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9ae59cab-561f-44b1-a14c-13e1e117e552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:03.651974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506d371-b1e8-43e9-a951-e204fad2dace None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:03.687943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:03.688582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.688861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.689129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.689755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:03.690050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:03.691516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:03.696923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 473/931] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:18:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:03.702211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:03.720669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 459/932] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:03.764870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:03.768600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59cab-561f-44b1-a14c-13e1e117e552 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:03.824236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a661d-de82-4370-bdbc-6b1e10db7e17 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:03.859204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:03.862024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:03.862620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.862900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.863220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.863843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:03.864175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:03.866404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:03.871467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 474/933] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:18:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:03.901402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59cab-561f-44b1-a14c-13e1e117e552 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:03.940483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:03.941423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:03.941852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:03.942304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:03.955235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:03.961096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:03.962308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:03.963361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:03.965531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 460/934] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Sep 1 00:18:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:03.971777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.005942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.105937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ecfe7-6317-48f6-9bf6-f429a4f0c408 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.121020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.126555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2980eb-1251-4d45-9e0a-70229324dc23 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.142431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a5255-38ec-4d57-aff3-cc85a1ef3c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.143032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a5255-38ec-4d57-aff3-cc85a1ef3c42 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.143310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a5255-38ec-4d57-aff3-cc85a1ef3c42 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.143582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a5255-38ec-4d57-aff3-cc85a1ef3c42 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.144241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a5255-38ec-4d57-aff3-cc85a1ef3c42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:04.144574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a5255-38ec-4d57-aff3-cc85a1ef3c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.145984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a5255-38ec-4d57-aff3-cc85a1ef3c42 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.158667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 475/935] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Sep 1 00:18:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:04.158667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75684fe-d4d8-4031-86ce-b1d1cfdb19c8 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.158667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75684fe-d4d8-4031-86ce-b1d1cfdb19c8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.158667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75684fe-d4d8-4031-86ce-b1d1cfdb19c8 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.160469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.160912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 476/936] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:04.162217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75684fe-d4d8-4031-86ce-b1d1cfdb19c8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.172529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66652af-0f4d-474f-8d79-851316868633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.173163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66652af-0f4d-474f-8d79-851316868633 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.173667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66652af-0f4d-474f-8d79-851316868633 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.173775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66652af-0f4d-474f-8d79-851316868633 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.174276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66652af-0f4d-474f-8d79-851316868633 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.175641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66652af-0f4d-474f-8d79-851316868633 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-e66652af-0f4d-474f-8d79-851316868633 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:04.184994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:04.186036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.189487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 461/937] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:04.190350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ffabf-27a8-459f-9465-1e411efe7ba2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.190350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ffabf-27a8-459f-9465-1e411efe7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.190350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ffabf-27a8-459f-9465-1e411efe7ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.207238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-386ffabf-27a8-459f-9465-1e411efe7ba2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:04.208518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-386ffabf-27a8-459f-9465-1e411efe7ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:04.274340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75684fe-d4d8-4031-86ce-b1d1cfdb19c8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.281110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 462/938] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:04.281769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ffabf-27a8-459f-9465-1e411efe7ba2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.332236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.332236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.332236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.332236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.342146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.343781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:04.359548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:04.360743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:04.361857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:04.361857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:04.361857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:04.363280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 477/939] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:04.368924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.390754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ffabf-27a8-459f-9465-1e411efe7ba2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.400236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.418300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.432149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.433121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.433549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.434000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.434775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:04.435223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.436923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.442101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 463/940] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:04.449106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.491776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912997d6-76e9-4af3-b67e-d6189789f24f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.534916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.535823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.536366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.536877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.537723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:04.538252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.539836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.553213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 478/941] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:04.560717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.572790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfdee7-112e-4f3e-bbf5-29909bdf7f74 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.611579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.612179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.612491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.612749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.613366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:04.613662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.615683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.620357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 464/942] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:04.626044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.660805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.674268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.676098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e126e6-690a-401d-ac75-49766824e570 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.712863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.714025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.714369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.714913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.724769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.725779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9690ab3-7e80-4e03-abf7-2d26bff2d145 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.726214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:18:04.741753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:04.742921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:18:04.744097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:04.745164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 479/943] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:04.746001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.772253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.772896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.773174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.773445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.774076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.775502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.778121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING keystone.server.flask.common [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 00:18:04.797821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.sql.core [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 00:18:04.797821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 00:18:04.797821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [parameters: {'id': '3519dd4038604587bbd77f8cc274416a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 00:18:04.797821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3519dd4038604587bbd77f8cc274416a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3519dd4038604587bbd77f8cc274416a. Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application conn.query(q) Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 00:18:04.805660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result.read() Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 00:18:04.806650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application next(self.gen) Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application yield resource Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application next(self.gen) Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise self.value Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application session.commit() Sep 01 00:18:04.807842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.session.flush() Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application compat.raise_( Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 00:18:04.808953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 00:18:04.810040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application conn.query(q) Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application result.read() Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 00:18:04.810985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [parameters: {'id': '3519dd4038604587bbd77f8cc274416a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.812155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:04.813216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3519dd4038604587bbd77f8cc274416a. Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:04.814264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 465/944] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Sep 1 00:18:04 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:04.814931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.861646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0237ad-0704-46e4-bc46-1205535f6ec0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.898272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.898883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.899156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.899430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.900131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] RBAC: Adding query filter params (interface=public, service_id=ad434cfdc61245a991c8c3a08f6ce526, region_id=RegionOne) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:04.900462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.901840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.912846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 480/945] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/endpoints?service_id=ad434cfdc61245a991c8c3a08f6ce526&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:04.912846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:04.924567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e71ad-51ae-4ed8-9cac-ea0c5663ea2f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:04.927805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.934813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:04.965083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:04.965682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:04.965955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:04.966226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:04.966952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:04.967248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:04.968894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:04.990694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 466/946] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:04.991516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:05.030904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de2f3-6e3c-4cfa-ba67-ebcd567bc15d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:05.066969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:05.068158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.068494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.068771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.076274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:05.078345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:18:05.090925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:05.091809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 481/947] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:05.092798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:05.102447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d24ab-9a53-4bbd-a81b-dbf6c3d89998 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:05.137949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:05.138834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.139111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.139388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.139968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:05.141351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:05.147842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 467/948] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:18:04 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:18:05.148631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:05.179338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:05.185415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:05.219564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd738a70-dcc0-4dd6-aae3-9ae9da69e31f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:05.273042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:05.273702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.273983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.274251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.277107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26a61-c4a2-44ba-b61b-57d2de39abdd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:05.290083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:05.291556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:05.307060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:05.308087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:05.309053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:05.309053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:05.309053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:05.313002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 482/949] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:05.314245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:05.329185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:05.329931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.330207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.330476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.331137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:05.331433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:05.332899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:05.352142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 468/950] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:18:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:05.439918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2f75f-3e45-44c8-9f33-0cbddbf1df5a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:05.467164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:05.479536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:05.480164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.480466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.480734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.481455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:05.481821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:05.483449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:05.498597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 483/951] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:05.504265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:05.602783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:05.616440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090ee8-3493-40ca-b3f5-f53fc32df34b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:05.660100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f882d-5869-48d3-a244-03341d916a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:05.660815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f882d-5869-48d3-a244-03341d916a7f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.661601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f882d-5869-48d3-a244-03341d916a7f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.661894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f882d-5869-48d3-a244-03341d916a7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.668794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f882d-5869-48d3-a244-03341d916a7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:05.670246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f882d-5869-48d3-a244-03341d916a7f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-1d3f882d-5869-48d3-a244-03341d916a7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:18:05.681899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:05.682900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:05.683995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 469/952] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:05.691018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:05.799516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2751b4-674f-4bb9-abe6-3101e29ba96d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:05.801332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919d9a-8086-4bf9-ac2d-444a45256ca4 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.801612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919d9a-8086-4bf9-ac2d-444a45256ca4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.802413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919d9a-8086-4bf9-ac2d-444a45256ca4 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.804075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 470/953] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:05.809741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442e45-a55a-4da2-a721-aa5f6a7f5734 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.810023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442e45-a55a-4da2-a721-aa5f6a7f5734 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.810295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442e45-a55a-4da2-a721-aa5f6a7f5734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.828784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2f442e45-a55a-4da2-a721-aa5f6a7f5734 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:05.830304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2f442e45-a55a-4da2-a721-aa5f6a7f5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:05.837442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:05.838106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:05.838380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:05.838801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:05.839491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:05.839841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:05.841407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:05.854498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 484/954] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:05.860529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:05.917720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:05.920630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 471/955] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:05.973618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c43f0-36af-4d8d-bd8d-7be2cfd3b8e2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:06.009215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718ba9e-72b0-4bd6-b4ab-11c3671e8a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:06.009878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ba9e-72b0-4bd6-b4ab-11c3671e8a87 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:06.010159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ba9e-72b0-4bd6-b4ab-11c3671e8a87 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:06.010434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ba9e-72b0-4bd6-b4ab-11c3671e8a87 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/b65fda206995485db38858538d48a176/roles/da03f118f51c4e86874b9270563bfeb4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:06.012621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718ba9e-72b0-4bd6-b4ab-11c3671e8a87 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=b65fda206995485db38858538d48a176, role_id=da03f118f51c4e86874b9270563bfeb4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:06.014063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718ba9e-72b0-4bd6-b4ab-11c3671e8a87 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:06.029277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 485/956] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:18:05 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/b65fda206995485db38858538d48a176/roles/da03f118f51c4e86874b9270563bfeb4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:18:06.187844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442e45-a55a-4da2-a721-aa5f6a7f5734 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:06.271301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:06.294222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442e45-a55a-4da2-a721-aa5f6a7f5734 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:06.333126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f1f3-e928-4a16-bd4f-088ede123f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:06.334058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f1f3-e928-4a16-bd4f-088ede123f97 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:06.334516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f1f3-e928-4a16-bd4f-088ede123f97 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:06.335061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f1f3-e928-4a16-bd4f-088ede123f97 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:06.335906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f1f3-e928-4a16-bd4f-088ede123f97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:06.337501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f1f3-e928-4a16-bd4f-088ede123f97 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:06.358351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 472/957] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:18:06 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:18:07.184707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcc3e-5bb9-4688-b95b-fa9fc4e473a0 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:07.185266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcc3e-5bb9-4688-b95b-fa9fc4e473a0 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:07.185266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcc3e-5bb9-4688-b95b-fa9fc4e473a0 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:07.186791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 486/958] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:07.193021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058b59f-3a5a-4df0-85bd-aa09197eaebd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:07.193922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058b59f-3a5a-4df0-85bd-aa09197eaebd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:07.194414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058b59f-3a5a-4df0-85bd-aa09197eaebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:07.212723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e058b59f-3a5a-4df0-85bd-aa09197eaebd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:07.214166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e058b59f-3a5a-4df0-85bd-aa09197eaebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:07.293915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 473/959] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:07.448601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a82f-518d-4c45-a5f0-3e3076ed6f8d None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:07.448976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a82f-518d-4c45-a5f0-3e3076ed6f8d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:07.449354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a82f-518d-4c45-a5f0-3e3076ed6f8d None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:07.451140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 487/960] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:07.457042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddca467-74d4-474f-8ed1-fe281df794e3 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:07.457555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddca467-74d4-474f-8ed1-fe281df794e3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:07.458454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddca467-74d4-474f-8ed1-fe281df794e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:07.483043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0ddca467-74d4-474f-8ed1-fe281df794e3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:07.484242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0ddca467-74d4-474f-8ed1-fe281df794e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:07.552755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:07.562302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 474/961] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:07.573300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2a82f-518d-4c45-a5f0-3e3076ed6f8d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:07.676921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2a82f-518d-4c45-a5f0-3e3076ed6f8d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:07.679609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:07.714831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:07.715436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:07.715713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:07.715988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:07.716630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:07.718012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:07.727752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:07.729290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:07.730213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:07.734137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 488/962] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:18:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:07.735672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddca467-74d4-474f-8ed1-fe281df794e3 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:07.837742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddca467-74d4-474f-8ed1-fe281df794e3 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:07.870588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:07.872819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:07.873428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:07.873704 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:07.873976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:07.874604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:07.874906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:07.876275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:07.886500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 475/963] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:07.889318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:07.950357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:07.996657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1eb2-d8d3-4c15-ba0b-e29c6dbfb37f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.014542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0135a-2794-4191-a0ab-6d764f898d3c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.034580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.035370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.035836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.036491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.037122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:08.037420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:08.038787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:08.048467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 476/964] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:08.049732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:08.061219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.062558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.063195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.063804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.064708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:08.067473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:08.071092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING keystone.server.flask.common [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 00:18:08.090076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.sql.core [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 00:18:08.090076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 00:18:08.090076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [parameters: {'user_id': '5bcf73a353c543cba8dc5d9d7a9247b9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 00:18:08.090076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b1850c87-311e-4ab2-b7f8-924bc95e2c1b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application conn.query(q) Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application result.read() Sep 01 00:18:08.109954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 00:18:08.110966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application next(self.gen) Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application yield resource Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application next(self.gen) Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise self.value Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application session.commit() Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 00:18:08.112015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self.session.flush() Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application compat.raise_( Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 00:18:08.113000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 00:18:08.113972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application conn.query(q) Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application result.read() Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 00:18:08.115498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [parameters: {'user_id': '5bcf73a353c543cba8dc5d9d7a9247b9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:08.116521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 00:18:08.117358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 489/965] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Sep 1 00:18:07 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eae2c-5e7c-4c06-8785-70c14ec36e73 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eae2c-5e7c-4c06-8785-70c14ec36e73 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.120904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eae2c-5e7c-4c06-8785-70c14ec36e73 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.121501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 490/966] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:08.123145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eae2c-5e7c-4c06-8785-70c14ec36e73 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:08.158544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:08.170254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5502f-a7eb-44dd-aa56-9b7a96ec9f68 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.194561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:08.207227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f313ee-41e1-4064-bda7-6fcb776d8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.207832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f313ee-41e1-4064-bda7-6fcb776d8e15 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.208146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f313ee-41e1-4064-bda7-6fcb776d8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.208461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f313ee-41e1-4064-bda7-6fcb776d8e15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.209161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f313ee-41e1-4064-bda7-6fcb776d8e15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:08.210538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f313ee-41e1-4064-bda7-6fcb776d8e15 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:08.233280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 477/967] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:18:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:18:08.234628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5466b-9792-4e30-b037-6921a8c3a951 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.234917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5466b-9792-4e30-b037-6921a8c3a951 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.235186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5466b-9792-4e30-b037-6921a8c3a951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.256042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2df5466b-9792-4e30-b037-6921a8c3a951 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:08.257215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2df5466b-9792-4e30-b037-6921a8c3a951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:08.268859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eae2c-5e7c-4c06-8785-70c14ec36e73 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.325126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.325764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.326039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.326532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.335309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:08.336938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:08.340428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 478/968] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:08.340428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e04a1-7de3-42a1-82db-8b3cc53e3a67 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.340428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e04a1-7de3-42a1-82db-8b3cc53e3a67 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.340428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e04a1-7de3-42a1-82db-8b3cc53e3a67 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.344419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 479/969] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:08.347416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d55eb-ccd1-4a2c-bbbb-d12a3aadfdd5 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.347876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d55eb-ccd1-4a2c-bbbb-d12a3aadfdd5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.348412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d55eb-ccd1-4a2c-bbbb-d12a3aadfdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:18:08.357178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:08.358235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 00:18:08.359247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.363289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 491/970] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:18:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:08.364306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:08.373228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-935d55eb-ccd1-4a2c-bbbb-d12a3aadfdd5 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:08.375325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-935d55eb-ccd1-4a2c-bbbb-d12a3aadfdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:08.465444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 480/971] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:08.472054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:08.488021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a763d5-b481-4407-ae6b-faad455406ae None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.523023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.523560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.523837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.524109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.527074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:08.527074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:08.527074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:08.561202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 492/972] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Sep 1 00:18:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:08.620354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d55eb-ccd1-4a2c-bbbb-d12a3aadfdd5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:08.664477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:08.728260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d55eb-ccd1-4a2c-bbbb-d12a3aadfdd5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.743697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:08.768949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.769592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.769874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.770133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.785713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:08.789859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:08.790843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:08.791706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 481/973] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Sep 1 00:18:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:08.797065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:08.872201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a0121-92d5-4f45-97c0-155a71628723 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.901881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:08.905944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709c83f-5837-4375-87ac-7a61947c5fae None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:08.909609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.910243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.910525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.910796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.911485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:08.913032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:08.923384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:08.924751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:08.925729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 493/974] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:08.930810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:08.941783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:08.948317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:08.949239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:08.949815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:08.950299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:08.951266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:08.951767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:08.953499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:08.963428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 482/975] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Sep 1 00:18:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:08.968732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.040921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088e64-fa83-46e9-a28f-5f5685d538a3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.068177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b941e-96cd-4d28-98b7-4fd75d5868ca None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.076612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.077676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.078041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.078289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.078908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:09.079340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.080709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.086108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 494/976] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:18:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:09.091678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.103769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.104415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.104688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.104959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.115768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.117237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:09.131443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:09.132565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:09.133512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:09.133512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:09.133512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:09.133512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 483/977] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:09.138151 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.153610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:09.166691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:09.198944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044a3f-90d1-45e8-8847-30987fa01758 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.233581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.234288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.234571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.234843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.235461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:09.235762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.237160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.241992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 495/978] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:09.247627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.251952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff5ed-f38b-446f-ae67-7abdc04b4fca None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.288652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.289261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.289537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.289808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.290439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:09.290741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.292160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.308640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 484/979] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:09.309514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.352653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb2e9f-12de-4a7f-a0a9-3463fc4a0ec8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.383700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:09.386957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.387580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.387861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.388133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.388873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] RBAC: Adding query filter params (interface=public, service_id=dc53a05fcb454da98e03bd5690d24b5f, region_id=RegionOne) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:09.389181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.390607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.393384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:09.397324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 496/980] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/endpoints?service_id=dc53a05fcb454da98e03bd5690d24b5f&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:09.402718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.420494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e147220-1617-492e-ab3a-5da8e360ebec None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.456542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.457305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.457578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.457895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.465214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.466892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:18:09.479549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:09.480535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 00:18:09.481513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:09.485426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 485/981] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:09.486141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.509367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b550e4-7788-45a8-a242-abeddae64fda None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.544431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.544960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.545234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.545501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.546094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.547763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.554246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 497/982] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:18:09.609210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa38d7-ef4c-45a2-aa71-117f3ead6380 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.641975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:09.648548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.649174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.649450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.649719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.650452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:09.650756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.652210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.677191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 486/983] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:09.678565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:09.748211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:09.788629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb996-31ff-4100-b725-989c1bdf3513 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:09.822487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:09.823013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:09.823290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:09.823559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:09.891304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:09.892799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:09.952863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:09.998224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 498/984] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:09.999607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:10.104484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e7f68-9d72-4726-9d51-c21285ce3285 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:10.139490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8cdf6-13d8-4e88-af83-9cef1e88ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:10.140148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8cdf6-13d8-4e88-af83-9cef1e88ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.140450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8cdf6-13d8-4e88-af83-9cef1e88ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.140724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8cdf6-13d8-4e88-af83-9cef1e88ebc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.151741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8cdf6-13d8-4e88-af83-9cef1e88ebc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:10.153241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8cdf6-13d8-4e88-af83-9cef1e88ebc1 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-c9f8cdf6-13d8-4e88-af83-9cef1e88ebc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:10.168547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:10.169518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:10.170453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:10.170453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:10.170453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:10.171201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 487/985] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:10.175342 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:10.268833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f255cc-2aae-44ca-aa14-68738dd5783b None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.269354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f255cc-2aae-44ca-aa14-68738dd5783b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.269354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f255cc-2aae-44ca-aa14-68738dd5783b None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.271279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 488/986] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:10.275939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15accc42-d7b2-4c26-968e-0c5bc5744939 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.276217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15accc42-d7b2-4c26-968e-0c5bc5744939 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.276515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15accc42-d7b2-4c26-968e-0c5bc5744939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.277013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb55008-fb59-4824-a35e-984243b36fcb None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:10.295495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-15accc42-d7b2-4c26-968e-0c5bc5744939 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:10.296699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-15accc42-d7b2-4c26-968e-0c5bc5744939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:10.313970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:10.314576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.314853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.315124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.315757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:10.316057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:10.317493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:10.333649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 499/987] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:10.334654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:10.337223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:10.360864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:10.372315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 489/988] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:10.440989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a5e5-4d14-45b9-8b8b-cebabbf71b8c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:10.475665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:10.476586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.477052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.477508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.484961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:10.486599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:18:10.498086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:10.499065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:10.500186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:10.501988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 500/989] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:10.507750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15accc42-d7b2-4c26-968e-0c5bc5744939 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:10.607743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15accc42-d7b2-4c26-968e-0c5bc5744939 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:10.639525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:10.643002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:10.643606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.643881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.644151 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.644868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:10.645168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:10.647153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:10.658912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 490/990] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:10.665182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:10.698494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:10.731029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:10.749350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751ae6a-9515-4968-9484-1e375aeefabb None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:10.771361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df0df-9aee-4172-95ea-8de7bf6a03c4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:10.787135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:10.787848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.788130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.788572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.789006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:10.790377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:10.799236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:10.800241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:10.802328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 501/991] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:18:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:10.806745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:10.808797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:10.809391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.809663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.809933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.810632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] RBAC: Adding query filter params (role.id=da03f118f51c4e86874b9270563bfeb4, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=b65fda206995485db38858538d48a176) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:10.810936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:10.812339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:10.826322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 491/992] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:10 2022] GET /identity/v3/role_assignments?user.id=b65fda206995485db38858538d48a176&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=da03f118f51c4e86874b9270563bfeb4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:10.919149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e9d84-e262-4fdb-9ed9-4f9629af027b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:10.955300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:10.955911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:10.956194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:10.956501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:10.957136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:10.957421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:10.959336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:10.964200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 502/993] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:10.970295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:11.066129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:11.073165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537800-0933-4ec0-bbc8-ea2234fbf2ca None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:11.107622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:11.108221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:11.108534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:11.108781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:11.109397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:11.109693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:11.111053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:11.120736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 492/994] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:11.122282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:11.138047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:11.226909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737537-1420-4943-aa43-ed5517d4cfcc None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:11.261149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45bf35-eb88-4887-8e3b-c528e9f55e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:11.261756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45bf35-eb88-4887-8e3b-c528e9f55e57 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:11.262033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45bf35-eb88-4887-8e3b-c528e9f55e57 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:11.262302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45bf35-eb88-4887-8e3b-c528e9f55e57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:11.263000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45bf35-eb88-4887-8e3b-c528e9f55e57 None admin] RBAC: Adding query filter params (interface=admin, service_id=ad434cfdc61245a991c8c3a08f6ce526, region_id=RegionOne) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:11.263303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45bf35-eb88-4887-8e3b-c528e9f55e57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:11.264693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45bf35-eb88-4887-8e3b-c528e9f55e57 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:11.269880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 503/995] 10.222.0.13 () {56 vars in 1249 bytes} [Thu Sep 1 00:18:11 2022] GET /identity/v3/endpoints?service_id=ad434cfdc61245a991c8c3a08f6ce526&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:11.275967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:11.376829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8cf39-cdb4-4dc0-8ef6-9f8d3640318a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:11.410396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42031770-32fa-487f-aa05-c67feeb30b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:11.411015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42031770-32fa-487f-aa05-c67feeb30b70 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:11.411290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42031770-32fa-487f-aa05-c67feeb30b70 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:11.411553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42031770-32fa-487f-aa05-c67feeb30b70 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:11.412136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42031770-32fa-487f-aa05-c67feeb30b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:11.413530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42031770-32fa-487f-aa05-c67feeb30b70 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:11.419782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 493/996] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:18:11 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:18:11.472137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ec0d-9735-4468-b465-729caa34c78a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:11.472720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ec0d-9735-4468-b465-729caa34c78a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:11.472803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199ec0d-9735-4468-b465-729caa34c78a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:11.474156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 504/997] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:11.480158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4f7f-a428-4045-8718-37bcb1a32c58 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:11.480461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4f7f-a428-4045-8718-37bcb1a32c58 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:11.480665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4f7f-a428-4045-8718-37bcb1a32c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:11.500143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c1ac4f7f-a428-4045-8718-37bcb1a32c58 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:11.501406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c1ac4f7f-a428-4045-8718-37bcb1a32c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:11.530014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:11.582738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 494/998] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:11.848078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ec0d-9735-4468-b465-729caa34c78a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:11.927413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:11.954408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199ec0d-9735-4468-b465-729caa34c78a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:11.988336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:11.989594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:11.989943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:11.990290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] PATH_INFO: `/v3/services/compute` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:11.990931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:11.992362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:12.001041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:12.002224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 00:18:12.003286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:12.004641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 505/999] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:12.010310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4f7f-a428-4045-8718-37bcb1a32c58 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:12.112077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4f7f-a428-4045-8718-37bcb1a32c58 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:12.145317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:12.145912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:12.146178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:12.146447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:12.147059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:12.147354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:12.148728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:12.153527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 495/1000] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:18:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:12.158949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:12.259672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea45e4-ac40-43b4-83cd-a726ffea3abd None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:12.293832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e9f56-0da6-433f-9dc6-2e916d8ae336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:12.294441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e9f56-0da6-433f-9dc6-2e916d8ae336 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:12.294717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e9f56-0da6-433f-9dc6-2e916d8ae336 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:12.294986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e9f56-0da6-433f-9dc6-2e916d8ae336 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:12.295615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e9f56-0da6-433f-9dc6-2e916d8ae336 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:12.295914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e9f56-0da6-433f-9dc6-2e916d8ae336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:12.297304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e9f56-0da6-433f-9dc6-2e916d8ae336 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:12.306604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 506/1001] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Sep 1 00:18:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:12.307817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:12.327236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:12.409414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c3377-a3fa-40c6-b866-316a164c1ca7 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:12.443634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738d94-63db-4cb7-8917-1d0a0f10bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:12.444234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738d94-63db-4cb7-8917-1d0a0f10bb7a None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:12.444552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738d94-63db-4cb7-8917-1d0a0f10bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:12.444819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738d94-63db-4cb7-8917-1d0a0f10bb7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:12.445468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738d94-63db-4cb7-8917-1d0a0f10bb7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:12.446815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738d94-63db-4cb7-8917-1d0a0f10bb7a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:12.476448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 496/1002] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:18:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:18:12.776454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36688be-fe7d-4d10-afca-eb4f42420e88 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:12.776993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36688be-fe7d-4d10-afca-eb4f42420e88 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:12.776993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36688be-fe7d-4d10-afca-eb4f42420e88 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:12.778359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 507/1003] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:12.783348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35baa80-f184-47db-ab79-d102dceb1831 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:12.783665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35baa80-f184-47db-ab79-d102dceb1831 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:12.783907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35baa80-f184-47db-ab79-d102dceb1831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:12.802496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b35baa80-f184-47db-ab79-d102dceb1831 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:12.803662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b35baa80-f184-47db-ab79-d102dceb1831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:12.870238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:12.877897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 497/1004] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:12 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:13.142709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36688be-fe7d-4d10-afca-eb4f42420e88 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:13.146606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:13.247671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36688be-fe7d-4d10-afca-eb4f42420e88 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:13.280504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8920e37-e7d8-4d4b-8175-81115e992076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:13.281124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920e37-e7d8-4d4b-8175-81115e992076 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:13.281397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920e37-e7d8-4d4b-8175-81115e992076 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:13.281661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920e37-e7d8-4d4b-8175-81115e992076 None admin] PATH_INFO: `/v3/services/image` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:13.282233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8920e37-e7d8-4d4b-8175-81115e992076 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:13.283588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8920e37-e7d8-4d4b-8175-81115e992076 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b8920e37-e7d8-4d4b-8175-81115e992076 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:13.292473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:13.293496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:13.294369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 508/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Sep 1 00:18:13 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:13.301050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35baa80-f184-47db-ab79-d102dceb1831 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:13.329317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27516e-0536-4f10-9e47-5cf63d7d2c41 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:13.329607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27516e-0536-4f10-9e47-5cf63d7d2c41 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:13.329878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27516e-0536-4f10-9e47-5cf63d7d2c41 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:13.331196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 509/1006] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:13.336094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e34d-1d25-4814-bf6f-fb7343dc5e78 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:13.336576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e34d-1d25-4814-bf6f-fb7343dc5e78 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:13.336857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e34d-1d25-4814-bf6f-fb7343dc5e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:13.356426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-dc49e34d-1d25-4814-bf6f-fb7343dc5e78 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:13.357955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-dc49e34d-1d25-4814-bf6f-fb7343dc5e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:13.405296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35baa80-f184-47db-ab79-d102dceb1831 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:13.426329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:13.433248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 510/1007] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:13 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:13.446285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:13.446901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:13.447180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:13.447454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:13.448083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] RBAC: Adding query filter params (name=image) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:13.448401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:13.449785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:13.459213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 498/1008] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:13.460802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e34d-1d25-4814-bf6f-fb7343dc5e78 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:13.572128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e34d-1d25-4814-bf6f-fb7343dc5e78 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:13.607614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:13.608220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:13.608531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:13.608803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:13.609425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:13.609726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:13.611099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:13.615732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 511/1009] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:13.704744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:13.771762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:13.810124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad26e2-b8ff-44a8-8c37-5435db696026 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:13.844056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:13.844794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:13.845069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:13.845336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:13.845904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:13.847262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:13.856138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:13.857350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:13.858213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 499/1010] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Sep 1 00:18:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:13.863429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:13.925095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:13.965638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216d7d2-28b7-44b4-ad29-2692232407c5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:13.999820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:14.000445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:14.000723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:14.000988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:14.001604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:14.001898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:14.003261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:14.012885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 512/1011] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:14.014072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:14.118466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3529e2-15a2-4bc9-abe4-f2b2ebb3570a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:14.144270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:14.153941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60a9c1-4f87-4f2c-9696-0f426cd50b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:14.154551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60a9c1-4f87-4f2c-9696-0f426cd50b0f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:14.154826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60a9c1-4f87-4f2c-9696-0f426cd50b0f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:14.155093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60a9c1-4f87-4f2c-9696-0f426cd50b0f None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:14.155705 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60a9c1-4f87-4f2c-9696-0f426cd50b0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:14.156008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60a9c1-4f87-4f2c-9696-0f426cd50b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:14.157422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60a9c1-4f87-4f2c-9696-0f426cd50b0f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:14.162599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 500/1012] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Sep 1 00:18:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:14.168054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:14.267565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26ab00-1f3b-4631-90d4-1b0f3c64de5e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:14.293121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:14.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74ba2e-b030-4632-8ee5-9a47a42d549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:14.303935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74ba2e-b030-4632-8ee5-9a47a42d549f None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:14.304214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74ba2e-b030-4632-8ee5-9a47a42d549f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:14.304519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74ba2e-b030-4632-8ee5-9a47a42d549f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:14.305187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74ba2e-b030-4632-8ee5-9a47a42d549f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:14.306552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74ba2e-b030-4632-8ee5-9a47a42d549f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:14.322444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 513/1013] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:18:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:18:14.477046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea900fe-6d35-4132-a8f2-a0ad4c9d0f0d None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:14.477562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea900fe-6d35-4132-a8f2-a0ad4c9d0f0d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:14.477654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea900fe-6d35-4132-a8f2-a0ad4c9d0f0d None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:14.479244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 501/1014] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:14.484448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b96a-d49b-4088-ba72-6960457d3406 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:14.484741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b96a-d49b-4088-ba72-6960457d3406 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:14.485014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599b96a-d49b-4088-ba72-6960457d3406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:14.508757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e599b96a-d49b-4088-ba72-6960457d3406 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:14.511983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e599b96a-d49b-4088-ba72-6960457d3406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:14.586559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 514/1015] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:14 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:14.855485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea900fe-6d35-4132-a8f2-a0ad4c9d0f0d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:14.960145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea900fe-6d35-4132-a8f2-a0ad4c9d0f0d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:14.994300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:14.994923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:14.995197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:14.995463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.006106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:15.010802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:15.011763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:15.012653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:15.016877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 502/1016] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Sep 1 00:18:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:15.018349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599b96a-d49b-4088-ba72-6960457d3406 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:15.119619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599b96a-d49b-4088-ba72-6960457d3406 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:15.132992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:15.155743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:15.156354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.156668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.156939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.157626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:15.157929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:15.159303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:15.172447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 515/1017] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Sep 1 00:18:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:15.173749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:15.229240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:15.277782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d6e8-b42a-480b-94de-6871e11c97a7 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:15.311723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:15.312350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.312660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.312927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.324091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:15.325628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:15.340323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:15.341414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:15.342752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:15.342752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:15.342752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:15.343157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 503/1018] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:15.347334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:15.452095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2ed33-c5dd-4611-96fa-ba5fe1679131 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:15.485616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69a23e-b0f9-490e-a03d-3a99fcf08c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:15.486222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a23e-b0f9-490e-a03d-3a99fcf08c25 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.486501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a23e-b0f9-490e-a03d-3a99fcf08c25 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.486774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a23e-b0f9-490e-a03d-3a99fcf08c25 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.487411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69a23e-b0f9-490e-a03d-3a99fcf08c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:15.487712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69a23e-b0f9-490e-a03d-3a99fcf08c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:15.489723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69a23e-b0f9-490e-a03d-3a99fcf08c25 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:15.501633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 516/1019] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:15.507301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:15.523680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056bb4-1500-4a42-a3ed-a08edc23e50e None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.523680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056bb4-1500-4a42-a3ed-a08edc23e50e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.523992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056bb4-1500-4a42-a3ed-a08edc23e50e None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.525443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 517/1020] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:15.530196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443391d8-87d6-4035-b158-2dea10a0ff52 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.530476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443391d8-87d6-4035-b158-2dea10a0ff52 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.530748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443391d8-87d6-4035-b158-2dea10a0ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.548907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-443391d8-87d6-4035-b158-2dea10a0ff52 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:15.550098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-443391d8-87d6-4035-b158-2dea10a0ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:15.581903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:15.618892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88044-65a1-4858-95f4-d36d5c66ce70 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:15.622132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:15.627350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 518/1021] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:15 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:15.655576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:15.656204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.656507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.656780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.664333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:15.665792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:18:15.677468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:15.678433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:18:15.679437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:15.683236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 504/1022] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:18:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:15.684606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443391d8-87d6-4035-b158-2dea10a0ff52 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:15.785384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443391d8-87d6-4035-b158-2dea10a0ff52 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:15.819844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:15.820475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.820757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.821027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:15.821750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:15.822056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:15.823491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:15.844481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 519/1023] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:18:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:15.847173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:15.890447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:15.916128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:15.958551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e50dff-d8f4-472b-903e-887bdf74bffa None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:15.994368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd6a42-553c-4909-8ae2-e92705b65dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:15.994980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6a42-553c-4909-8ae2-e92705b65dda None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:15.995366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6a42-553c-4909-8ae2-e92705b65dda None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:15.995641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6a42-553c-4909-8ae2-e92705b65dda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.000981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8643c0-a86a-4036-b6e8-23342f0848f7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:16.028079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:16.037423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:16.037965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.038243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.038513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.039155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.040568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.060431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 520/1024] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:18:15 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:18:16.070771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd6a42-553c-4909-8ae2-e92705b65dda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.072300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd6a42-553c-4909-8ae2-e92705b65dda None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.198615 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 505/1025] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:15 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:16.200522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:16.253463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f21ef-cb50-4deb-b427-415c1490fb95 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.253744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f21ef-cb50-4deb-b427-415c1490fb95 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.254017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f21ef-cb50-4deb-b427-415c1490fb95 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.256045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 506/1026] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:16.261015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649bd8-d37e-4059-94f7-1cdab12e138f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.261298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649bd8-d37e-4059-94f7-1cdab12e138f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.261572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649bd8-d37e-4059-94f7-1cdab12e138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.281062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-aa649bd8-d37e-4059-94f7-1cdab12e138f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:16.282313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-aa649bd8-d37e-4059-94f7-1cdab12e138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:16.289508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:16.316012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb2955-e647-4f37-a07b-32510526ae47 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:16.347323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:16.350338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:16.351076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.351242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.351513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.364413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 507/1027] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:16.364568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.365820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:16.380414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:16.381402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:16.382320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:16.382320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:16.382320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:16.382320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 521/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:16.387240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa649bd8-d37e-4059-94f7-1cdab12e138f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:16.486558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa649bd8-d37e-4059-94f7-1cdab12e138f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:16.529619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:16.530269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.530492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.530760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.531399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:16.531697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.533088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.545376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 508/1029] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:16.550976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:16.627571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:16.653837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337198-46d7-48ad-b9f1-918691c04efd None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:16.684244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:16.690811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:16.691476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.691760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.692585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.692990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:16.699891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.701382 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:18:16.716466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:16.717456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:16.718389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 522/1030] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:16.723705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:16.748240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3448060-6ca7-44c1-8e48-fff98c8e1a48 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:16.781757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:16.782370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.782644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.782913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.783997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.785452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.787323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 509/1031] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:16.792928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:16.833822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e19ab2-46ee-47e6-ae6e-223d1f5bdced None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:16.869692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:16.870483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.870929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.871347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.872309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:16.872862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.874428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.893309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c7314-704d-465c-808a-67d0d462edf5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:16.893480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 523/1032] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:16.894394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:16.914025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:16.927270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b34e15-a7a2-4d7a-b882-530fdbbaef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:16.927864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b34e15-a7a2-4d7a-b882-530fdbbaef52 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:16.928130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b34e15-a7a2-4d7a-b882-530fdbbaef52 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:16.928598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b34e15-a7a2-4d7a-b882-530fdbbaef52 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:16.929052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b34e15-a7a2-4d7a-b882-530fdbbaef52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:16.930531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b34e15-a7a2-4d7a-b882-530fdbbaef52 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:16.948782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:16.961193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 510/1033] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:18:16 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:18:17.013623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4e21-b87d-41ea-82a9-b6cebe968ca9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:17.053146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb2b8e-b333-4e7a-b565-f35e3df88950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:17.054447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb2b8e-b333-4e7a-b565-f35e3df88950 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:17.054722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb2b8e-b333-4e7a-b565-f35e3df88950 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:17.054989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb2b8e-b333-4e7a-b565-f35e3df88950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:17.055716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb2b8e-b333-4e7a-b565-f35e3df88950 None admin] RBAC: Adding query filter params (role.id=da03f118f51c4e86874b9270563bfeb4, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:17.056018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb2b8e-b333-4e7a-b565-f35e3df88950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:17.057486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb2b8e-b333-4e7a-b565-f35e3df88950 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:17.072697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 524/1034] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:16 2022] GET /identity/v3/role_assignments?user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=da03f118f51c4e86874b9270563bfeb4 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:18.012353 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466758c5-b2c2-4f7c-87bf-1bb90d7442e8 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:18.013181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466758c5-b2c2-4f7c-87bf-1bb90d7442e8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:18.013181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466758c5-b2c2-4f7c-87bf-1bb90d7442e8 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:18.014226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 511/1035] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:18.020631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843dad-1952-4c92-9af0-788255b836c7 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:18.020938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843dad-1952-4c92-9af0-788255b836c7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:18.021212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843dad-1952-4c92-9af0-788255b836c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:18.039394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f3843dad-1952-4c92-9af0-788255b836c7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:18.040611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f3843dad-1952-4c92-9af0-788255b836c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:18.114375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 525/1036] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:18.389194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466758c5-b2c2-4f7c-87bf-1bb90d7442e8 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:18.491538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466758c5-b2c2-4f7c-87bf-1bb90d7442e8 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:18.533099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:18.533735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:18.534013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:18.534349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] PATH_INFO: `/v3/services/image` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:18.534931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:18.536952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:18.545814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:18.546866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:18.547744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:18.551904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 512/1037] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Sep 1 00:18:18 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:18.553365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3843dad-1952-4c92-9af0-788255b836c7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:18.601332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:18.664684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3843dad-1952-4c92-9af0-788255b836c7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:18.698240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:18.698851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:18.699129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:18.699397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:18.700022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] RBAC: Adding query filter params (name=image) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:18.700319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:18.701708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:18.711523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 526/1038] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:18.713060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:18.754515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:18.815789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46c833-9e47-4d21-951d-2522c54d1e8b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:18.849808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dc18f-997a-47ad-8fef-b1f0e6408342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:18.850410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc18f-997a-47ad-8fef-b1f0e6408342 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:18.850681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc18f-997a-47ad-8fef-b1f0e6408342 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:18.850951 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc18f-997a-47ad-8fef-b1f0e6408342 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:18.851566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dc18f-997a-47ad-8fef-b1f0e6408342 None admin] RBAC: Adding query filter params (type=image) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:18.851858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dc18f-997a-47ad-8fef-b1f0e6408342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:18.853497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dc18f-997a-47ad-8fef-b1f0e6408342 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:18.858386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 513/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:18.864220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:18.940526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259b942-db4b-405f-951c-ff660df2e7ea None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:18.940955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259b942-db4b-405f-951c-ff660df2e7ea None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:18.941229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259b942-db4b-405f-951c-ff660df2e7ea None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:18.943105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 514/1040] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:18.948091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a87558-a78a-46c2-84ec-e6b84a6e1170 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:18.948367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a87558-a78a-46c2-84ec-e6b84a6e1170 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:18.948661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a87558-a78a-46c2-84ec-e6b84a6e1170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:18.966831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-46a87558-a78a-46c2-84ec-e6b84a6e1170 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:18.967918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c277d0-91f8-4277-9431-3c578945cdec None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:18.968037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-46a87558-a78a-46c2-84ec-e6b84a6e1170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:18.978892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:19.004889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c003c19-945c-4d4e-8537-2b3de04cffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:19.005490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c003c19-945c-4d4e-8537-2b3de04cffdf None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.005763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c003c19-945c-4d4e-8537-2b3de04cffdf None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.006028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c003c19-945c-4d4e-8537-2b3de04cffdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.006712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c003c19-945c-4d4e-8537-2b3de04cffdf None admin] RBAC: Adding query filter params (interface=public, service_id=b58affe6d364447380c1e56108802e93, region_id=RegionOne) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:19.007015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c003c19-945c-4d4e-8537-2b3de04cffdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:19.008392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c003c19-945c-4d4e-8537-2b3de04cffdf None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:19.013268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 527/1041] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:18:18 2022] GET /identity/v3/endpoints?service_id=b58affe6d364447380c1e56108802e93&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:19.014468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e69ad-1dec-4cbd-888b-323497fc87f2 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.014747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e69ad-1dec-4cbd-888b-323497fc87f2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.015012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e69ad-1dec-4cbd-888b-323497fc87f2 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.016182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 528/1042] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:19.018621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e69ad-1dec-4cbd-888b-323497fc87f2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:19.039293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 515/1043] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:19.040546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d277-a459-49c1-9b6b-ee9bf76aef75 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.040825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d277-a459-49c1-9b6b-ee9bf76aef75 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.041092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d277-a459-49c1-9b6b-ee9bf76aef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.057801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c355d277-a459-49c1-9b6b-ee9bf76aef75 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:19.058970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c355d277-a459-49c1-9b6b-ee9bf76aef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:19.085584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:19.128471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 516/1044] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:19.131271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e69ad-1dec-4cbd-888b-323497fc87f2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:19.166865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:19.167662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.168093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.168563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.169332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:19.170856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:19.178412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 529/1045] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:18:19 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:18:19.308279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d277-a459-49c1-9b6b-ee9bf76aef75 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:19.393774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:19.412660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d277-a459-49c1-9b6b-ee9bf76aef75 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:19.434603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:19.450819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:19.451442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.451715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.451979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.453092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:19.454523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:19.456245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 517/1046] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:19.461760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:19.493895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:19.518636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818533-c678-4d6e-a6e1-d4c3ab087aa0 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:19.559463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:19.560130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.560599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.560802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.569756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce711b-1a48-4a94-ba70-8dcbdeeaa58d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:19.571913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:19.576775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:19.577724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:19.578782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 530/1047] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Sep 1 00:18:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:19.584051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:19.610396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:19.610999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.611277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.611546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.612185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:19.613701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:19.648440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 518/1048] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:18:19 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:18:19.690178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:19.698060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c2d5-b8e4-428a-ab73-8b4c11cac032 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:19.736457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:19.737085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.737360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.737625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.738350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:19.738686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:19.740762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:19.754741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 531/1049] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Sep 1 00:18:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:19.756147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:19.849790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:19.866905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddedffc-b301-43a3-af71-0b1358180740 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:19.900324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:19.900977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:19.901251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:19.901520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:19.912438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:19.913894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:19.928221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:19.929240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:19.930143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:19.930143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:19.930143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:19.930143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 519/1050] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:19.936401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:20.037974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af7da-6023-49bf-9edd-4506c886e694 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:20.071451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:20.072060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:20.072340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:20.072642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:20.073281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:20.073583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:20.074964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:20.093294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 532/1051] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:20.094578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:20.198101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f24ad9-7fb2-4129-b5f4-7e97355511d5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:20.233297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:20.233919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:20.234191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:20.234456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:20.242151 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:20.243576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:20.245423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:18:20.255751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:20.256979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:18:20.258211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:20.265480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 520/1052] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:18:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:20.266753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:20.288319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:20.372806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e693877-b414-4b24-8a5d-f23484b8f379 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:20.405550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:20.406137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:20.406418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:20.406691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:20.407407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:20.407714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:20.409161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:20.430559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 533/1053] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:18:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:20.431998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:20.536897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac61eef-def3-4b2c-acbe-70da24a9c705 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:20.571224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:20.571847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:20.572123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:20.572416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:20.583696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:20.585178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:20.599520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:20.605873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:20.606830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:20.606830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:20.606830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:20.606830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 521/1054] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:20.607078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:20.686331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:20.711710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148228a-b601-4283-94c9-a0242962a41f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:20.746403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:20.747015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:20.747295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:20.747569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:20.748207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:20.748540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:20.749924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:20.766287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 534/1055] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:20.767595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:20.819050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:20.871190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77048-8272-4816-b171-bc6be6b884ee None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:20.908232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55221-bf1b-4c06-be16-abc7f94be2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:20.908988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55221-bf1b-4c06-be16-abc7f94be2eb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:20.909266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55221-bf1b-4c06-be16-abc7f94be2eb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:20.909533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55221-bf1b-4c06-be16-abc7f94be2eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:20.916754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55221-bf1b-4c06-be16-abc7f94be2eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:20.918202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55221-bf1b-4c06-be16-abc7f94be2eb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-f3e55221-bf1b-4c06-be16-abc7f94be2eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:18:20.929287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:20.930199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:20.931147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 522/1056] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:20.937519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:21.053329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f51f37-51e4-4cd9-8546-64a7578bfcb3 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:21.089321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:21.089854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.090133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.090402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.091096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:21.091403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:21.092885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:21.095917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf1b8-48a2-4006-964f-6ebfd59aed04 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.096408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf1b8-48a2-4006-964f-6ebfd59aed04 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.096499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf1b8-48a2-4006-964f-6ebfd59aed04 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.097802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 523/1057] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:21.098949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:21.102866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154f63-8b08-4e89-b12f-7428f93ac2d6 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.103395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154f63-8b08-4e89-b12f-7428f93ac2d6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.103675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154f63-8b08-4e89-b12f-7428f93ac2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.116226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 535/1058] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:21.117397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:21.132966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-48154f63-8b08-4e89-b12f-7428f93ac2d6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:21.134217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-48154f63-8b08-4e89-b12f-7428f93ac2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:21.203852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 524/1059] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:21.221150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825295-202d-40a9-939f-e839cb2715f5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:21.255528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010d1da-b02f-4af7-8d25-0383642bb5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:21.256175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d1da-b02f-4af7-8d25-0383642bb5ad None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.256473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d1da-b02f-4af7-8d25-0383642bb5ad None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.256739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d1da-b02f-4af7-8d25-0383642bb5ad None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/c63bab6bcfed4cb3b05de6ad4a4b43a4/roles/da03f118f51c4e86874b9270563bfeb4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.258841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d1da-b02f-4af7-8d25-0383642bb5ad None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=c63bab6bcfed4cb3b05de6ad4a4b43a4, role_id=da03f118f51c4e86874b9270563bfeb4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:21.260256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d1da-b02f-4af7-8d25-0383642bb5ad None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:21.280408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 536/1060] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:18:21 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/c63bab6bcfed4cb3b05de6ad4a4b43a4/roles/da03f118f51c4e86874b9270563bfeb4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:18:21.471575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48154f63-8b08-4e89-b12f-7428f93ac2d6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:21.516128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:21.578539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48154f63-8b08-4e89-b12f-7428f93ac2d6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:21.598765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738c4e-5ce7-4e99-960f-10cf61893d7a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.599083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738c4e-5ce7-4e99-960f-10cf61893d7a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.599306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738c4e-5ce7-4e99-960f-10cf61893d7a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.600828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 537/1061] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:21.605798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90485-1a41-4881-a4d2-1d76b16a68f9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.606074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90485-1a41-4881-a4d2-1d76b16a68f9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.606358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90485-1a41-4881-a4d2-1d76b16a68f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.618875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:21.619525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.619801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.620070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] PATH_INFO: `/v3/services/image` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.620691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:21.622079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:21.625755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-eea90485-1a41-4881-a4d2-1d76b16a68f9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:21.626743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-eea90485-1a41-4881-a4d2-1d76b16a68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:21.631863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:21.633062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:21.633932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 525/1062] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Sep 1 00:18:21 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:21.641162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:21.687260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:21.705375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 538/1063] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:21.751975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb39bf-ead4-4250-8c7a-58097dbc66af None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:21.754261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:21.787917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:21.788555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.788835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.789105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.789728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] RBAC: Adding query filter params (name=image) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:21.790025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:21.791456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:21.801204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 526/1064] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:21.802163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90485-1a41-4881-a4d2-1d76b16a68f9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:21.902671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90485-1a41-4881-a4d2-1d76b16a68f9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:21.936861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:21.937493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:21.937782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:21.938041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:21.938683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] RBAC: Adding query filter params (type=image) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:21.938993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:21.940409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:21.950895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 539/1065] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:21.952544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:21.972057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:22.023279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:22.056245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e52ef-0140-4678-88c8-4e4be2ce00f4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:22.084436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1e58d-9db7-4231-bdce-e1bf60f566df None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:22.092063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:22.092760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:22.093038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:22.093308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:22.093958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:22.095324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:22.116535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 527/1066] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:18:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:18:22.133359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:22.134018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:22.134297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:22.134568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:22.147230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:22.152732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:22.153797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:22.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 540/1067] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:22.160123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:22.190551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:22.281312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36bc47-deab-4595-b283-ad67729e4f4d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:22.316816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:22.317770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:22.318269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:22.318731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:22.319579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:22.320073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:22.321662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:22.331080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 528/1068] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:22.337203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:22.441458 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb346d2-50e3-407a-bc87-ff3f1dbf357f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:22.448878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:22.477627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:22.478555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:22.478885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:22.479161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] PATH_INFO: `/v3/users/40c702c2349e41b28fd8d95f8c574439` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:22.493105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] RBAC: Authorizing `identity:get_user(user_id=40c702c2349e41b28fd8d95f8c574439)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:22.494559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:22.496323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 541/1069] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:22 2022] GET /identity/v3/users/40c702c2349e41b28fd8d95f8c574439 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:22.502201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:22.595602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:22.612714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13e80d-facd-4c7a-90a2-445ac2d64654 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:22.648493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:22.649099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:22.649375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:22.649644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:22.717711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:22.719199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:22.801640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:22.823511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 529/1070] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 00:18:22.824690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:22.924996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef722ad-cf27-49e6-ad28-049192b89d6f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:22.960497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38471d6f-3088-490c-be49-46117aa67893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:22.961128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38471d6f-3088-490c-be49-46117aa67893 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:22.961409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38471d6f-3088-490c-be49-46117aa67893 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:22.961684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38471d6f-3088-490c-be49-46117aa67893 None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:22.962790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38471d6f-3088-490c-be49-46117aa67893 None admin] RBAC: Authorizing `identity:get_project(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:22.964233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38471d6f-3088-490c-be49-46117aa67893 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:22.966095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 542/1071] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:22 2022] GET /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:22.971885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:23.071822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625f38-5d0f-488d-8740-a95ed2928bc5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:23.108067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302d224-faf7-4453-a4a9-f1015601919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:23.108703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302d224-faf7-4453-a4a9-f1015601919a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:23.108983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302d224-faf7-4453-a4a9-f1015601919a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:23.109258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302d224-faf7-4453-a4a9-f1015601919a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:23.109988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302d224-faf7-4453-a4a9-f1015601919a None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2, user.id=40c702c2349e41b28fd8d95f8c574439) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:23.110296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302d224-faf7-4453-a4a9-f1015601919a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:23.111726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302d224-faf7-4453-a4a9-f1015601919a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:23.124421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 530/1072] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:22 2022] GET /identity/v3/role_assignments?user.id=40c702c2349e41b28fd8d95f8c574439&scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:23.180650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b12413-cf5f-4550-b02b-e854654792fb None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:23.180898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b12413-cf5f-4550-b02b-e854654792fb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:23.181123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b12413-cf5f-4550-b02b-e854654792fb None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:23.182658 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 543/1073] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:23.188009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25ffb-96ac-4f3d-b4ae-69a31a813236 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:23.188297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25ffb-96ac-4f3d-b4ae-69a31a813236 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:23.188592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25ffb-96ac-4f3d-b4ae-69a31a813236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:23.208212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ffd25ffb-96ac-4f3d-b4ae-69a31a813236 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:23.209451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ffd25ffb-96ac-4f3d-b4ae-69a31a813236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:23.262924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:23.286108 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 531/1074] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:23.549121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b12413-cf5f-4550-b02b-e854654792fb None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:23.580564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:23.679464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b12413-cf5f-4550-b02b-e854654792fb None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:23.714731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:23.715361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:23.715639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:23.715909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:23.726313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:23.731404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:23.732343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 00:18:23.733231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:23.737581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 544/1075] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Sep 1 00:18:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:23.741686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25ffb-96ac-4f3d-b4ae-69a31a813236 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:23.847272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25ffb-96ac-4f3d-b4ae-69a31a813236 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:23.882120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72798696-549f-4475-bd32-7cb785e672e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:23.882715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798696-549f-4475-bd32-7cb785e672e0 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:23.882987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798696-549f-4475-bd32-7cb785e672e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:23.883249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798696-549f-4475-bd32-7cb785e672e0 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:23.883896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72798696-549f-4475-bd32-7cb785e672e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:23.884189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72798696-549f-4475-bd32-7cb785e672e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:23.885586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72798696-549f-4475-bd32-7cb785e672e0 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:23.899546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:23.899984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 532/1076] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Sep 1 00:18:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:24.007086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.021169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf6831-565d-432e-878b-2053348be717 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:24.061087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:24.061720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.061994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.062262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.073033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:24.074471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:24.089629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:24.090725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:24.091635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:24.091635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:24.091635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:24.091635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 545/1077] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:24.094618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d58f-920f-47e2-9c94-df352e998225 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.094909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d58f-920f-47e2-9c94-df352e998225 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.095188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d58f-920f-47e2-9c94-df352e998225 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.096965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 533/1078] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:24.098345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:24.102264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91422d-fa23-4f74-b871-da63b748b43d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.102541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91422d-fa23-4f74-b871-da63b748b43d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.102864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91422d-fa23-4f74-b871-da63b748b43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.122075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ee91422d-fa23-4f74-b871-da63b748b43d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:24.123256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ee91422d-fa23-4f74-b871-da63b748b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:24.161603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.209980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 534/1079] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:18:24.210175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa826240-0fa7-437d-b0d9-3382c7da23ee None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:24.244884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:24.245487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.245816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.246092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.246728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:24.247028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:24.248421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:24.265592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 546/1080] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:24.266665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91422d-fa23-4f74-b871-da63b748b43d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:24.367128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91422d-fa23-4f74-b871-da63b748b43d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:24.401375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:24.401991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.402270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.402540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.409553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:24.411516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:18:24.423171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:24.424152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:24.430320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 535/1081] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:24.430948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:24.434597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.465544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:24.502182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.542321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395714e-4be6-49b3-8481-97c3d6f4fb3d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:24.576965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:24.577637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.577920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.578196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.579008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:24.579346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:24.580943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:24.587195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919c9b-c007-4651-b2f1-6ef22628b0bb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:24.598752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 547/1082] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:24.604585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:24.628065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:24.628722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.628996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.629504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.666643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.700784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:24.702239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:24.706954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162045-19ae-4e54-92ef-99ab4942eedf None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:24.734823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.744985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:24.745592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.745868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.746135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.807547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 536/1083] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 00:18:24.813355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:24.816373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:24.818673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:24.881282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.915466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56deca-7ae2-4936-b411-8c25312e1246 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:24.929601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 548/1084] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 00:18:24.930641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:24.950033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:24.956037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:24.956694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:24.956981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:24.957312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:24.967413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:24.968903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:24.986939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:24.987938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:24.989474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:24.989474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:24.989474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:24.989474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 537/1085] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:24.994693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.040166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c7569-9c2c-4265-be37-36e1313b9011 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.073333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ccea0-cad8-4e6c-91e3-0f95cbd9ad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.073915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ccea0-cad8-4e6c-91e3-0f95cbd9ad5d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.074192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ccea0-cad8-4e6c-91e3-0f95cbd9ad5d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.074461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ccea0-cad8-4e6c-91e3-0f95cbd9ad5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.084842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ccea0-cad8-4e6c-91e3-0f95cbd9ad5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.086317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ccea0-cad8-4e6c-91e3-0f95cbd9ad5d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.092643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc677f70-eaa8-44c2-a5ea-c6d38018cacc None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-699ccea0-cad8-4e6c-91e3-0f95cbd9ad5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:25.101257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:25.102393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:18:25.103796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:25.103796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:18:25.103796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:25.103796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 549/1086] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:25.103796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90bbc-3fb1-4738-aba0-07c576aa13ce None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.104153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90bbc-3fb1-4738-aba0-07c576aa13ce None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.104281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90bbc-3fb1-4738-aba0-07c576aa13ce None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.105662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 550/1087] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:25.109208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e90bbc-3fb1-4738-aba0-07c576aa13ce None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.125288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:25.130581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c06a-7b9f-412a-97d6-0fdef50774ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.131186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c06a-7b9f-412a-97d6-0fdef50774ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.131514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c06a-7b9f-412a-97d6-0fdef50774ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.131733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c06a-7b9f-412a-97d6-0fdef50774ef None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.132365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c06a-7b9f-412a-97d6-0fdef50774ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:25.132702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c06a-7b9f-412a-97d6-0fdef50774ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.134080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c06a-7b9f-412a-97d6-0fdef50774ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.147019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 538/1088] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:25.148169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af38c-5afe-48be-9e25-f80a21101935 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.148473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af38c-5afe-48be-9e25-f80a21101935 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.148748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af38c-5afe-48be-9e25-f80a21101935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.169031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-bf1af38c-5afe-48be-9e25-f80a21101935 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:25.170266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bf1af38c-5afe-48be-9e25-f80a21101935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:25.217279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:25.223750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e90bbc-3fb1-4738-aba0-07c576aa13ce None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.250995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 539/1089] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:25.264104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.264766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.265045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.265315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.265970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:25.266270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.267669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.281210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 551/1090] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:25.287532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1af38c-5afe-48be-9e25-f80a21101935 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.394675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1af38c-5afe-48be-9e25-f80a21101935 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.429917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.430537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.430809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.431074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.437674 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.439111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:18:25.450696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:25.451794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:25.452790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 540/1091] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:25.457827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.526394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.531737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:25.557420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d7555-68f4-437a-b889-903c2fc9578d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.560113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:25.591475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.592080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.592355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.592655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.593335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:25.593634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.595180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.607651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 552/1092] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:25.614553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.628633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c3ec1-2196-4bc5-b569-d8c3d8ec2007 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.662426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.662974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.663247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.663514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.673565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:25.679100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:25.680188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:25.685678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 541/1093] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:18:25.686573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.716553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3d91-42e5-4d5a-83c5-3a06565604cd None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.750376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.750974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.751248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.751515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.752238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] RBAC: Adding query filter params (role.id=da03f118f51c4e86874b9270563bfeb4, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:25.752573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.754010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.755718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:25.768439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 553/1094] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/role_assignments?user.id=c63bab6bcfed4cb3b05de6ad4a4b43a4&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=da03f118f51c4e86874b9270563bfeb4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:25.779353 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:25.787671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3eaa-f1e5-433c-9f7c-c735e6674557 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.823706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.824316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.824618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.824885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.825550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:25.825846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.827463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.837133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 542/1095] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:25.843035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:25.945227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758f9f-4a13-4f1c-a874-dd197281d9d1 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:25.979609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:25.980240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:25.980546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:25.980813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] PATH_INFO: `/v3/users/40c702c2349e41b28fd8d95f8c574439` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:25.981922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] RBAC: Authorizing `identity:get_user(user_id=40c702c2349e41b28fd8d95f8c574439)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:25.983345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:25.984948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 554/1096] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/users/40c702c2349e41b28fd8d95f8c574439 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:25.990805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:26.100981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea537-0046-41a5-99a1-5650c148c657 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:26.134281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784bbf6-a25b-476f-b8d3-3f00011171ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:26.134900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784bbf6-a25b-476f-b8d3-3f00011171ee None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:26.135179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784bbf6-a25b-476f-b8d3-3f00011171ee None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:26.135443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784bbf6-a25b-476f-b8d3-3f00011171ee None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:26.136568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784bbf6-a25b-476f-b8d3-3f00011171ee None admin] RBAC: Authorizing `identity:get_project(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:26.137998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784bbf6-a25b-476f-b8d3-3f00011171ee None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:26.139626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 543/1097] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:25 2022] GET /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:26.147122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:26.214486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:26.249868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340e6eb-ee87-4b81-acf0-00288f3ff5fa None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:26.283623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4441d6-fea0-4a95-ae79-dcc142ccc620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:26.284276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4441d6-fea0-4a95-ae79-dcc142ccc620 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:26.284576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4441d6-fea0-4a95-ae79-dcc142ccc620 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:26.284847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4441d6-fea0-4a95-ae79-dcc142ccc620 None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2/users/40c702c2349e41b28fd8d95f8c574439/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:26.286923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4441d6-fea0-4a95-ae79-dcc142ccc620 None admin] RBAC: Authorizing `identity:create_grant(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2, user_id=40c702c2349e41b28fd8d95f8c574439, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:26.288355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4441d6-fea0-4a95-ae79-dcc142ccc620 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:26.301907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 555/1098] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:18:26 2022] PUT /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2/users/40c702c2349e41b28fd8d95f8c574439/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:18:28.169883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79260-26fc-41e6-9b5b-8d66369c7deb None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:28.170410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79260-26fc-41e6-9b5b-8d66369c7deb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:28.170410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79260-26fc-41e6-9b5b-8d66369c7deb None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:28.171735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 544/1099] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:28.176950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb0ee-5210-4ffb-88bd-6afacc9c88c8 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:28.177347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb0ee-5210-4ffb-88bd-6afacc9c88c8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:28.177500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb0ee-5210-4ffb-88bd-6afacc9c88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:28.195697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d63eb0ee-5210-4ffb-88bd-6afacc9c88c8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:28.196908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d63eb0ee-5210-4ffb-88bd-6afacc9c88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:28.261842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 556/1100] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:28.527827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d79260-26fc-41e6-9b5b-8d66369c7deb None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:28.552572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:28.626812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d79260-26fc-41e6-9b5b-8d66369c7deb None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:28.658675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:28.659282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:28.659555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:28.659821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:28.670241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:28.675056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:28.676801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:28.677907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 545/1101] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:28.682724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eb0ee-5210-4ffb-88bd-6afacc9c88c8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:28.737398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:28.780143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eb0ee-5210-4ffb-88bd-6afacc9c88c8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:28.813355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:28.813949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:28.814234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:28.814506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:28.815164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:28.815465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:28.816916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:28.824737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 557/1102] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:28.830296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:28.911259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:28.927104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0212e-91b8-4c49-b11b-934a7db965a3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:28.959157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:28.959760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:28.960031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:28.960296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] PATH_INFO: `/v3/users/40c702c2349e41b28fd8d95f8c574439` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:28.961403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] RBAC: Authorizing `identity:get_user(user_id=40c702c2349e41b28fd8d95f8c574439)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:28.962812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:28.964341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 546/1103] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:28 2022] GET /identity/v3/users/40c702c2349e41b28fd8d95f8c574439 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:28.970187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:29.067691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735043-a5f6-4c1b-a5a8-659ce6810862 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:29.084735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:29.102024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:29.102622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:29.102897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:29.103419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:29.167725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:29.169178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:29.262239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 558/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:29.268100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:29.363577 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d43f3-6d0f-429c-a528-266a9968f6c8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:29.396328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d28d7-9dee-4bfd-9d3a-276808b63753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:29.396995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d28d7-9dee-4bfd-9d3a-276808b63753 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:29.397267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d28d7-9dee-4bfd-9d3a-276808b63753 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:29.397534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d28d7-9dee-4bfd-9d3a-276808b63753 None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:29.398619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d28d7-9dee-4bfd-9d3a-276808b63753 None admin] RBAC: Authorizing `identity:get_project(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:29.400044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d28d7-9dee-4bfd-9d3a-276808b63753 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:29.401647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 547/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:29 2022] GET /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:29.407502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:29.424992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:29.502550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869983b-822c-4c21-9de7-5cb45d0bfe4f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:29.535982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb89ccf-2e3c-41b7-931d-719fdaf48c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:29.536652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89ccf-2e3c-41b7-931d-719fdaf48c23 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:29.536936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89ccf-2e3c-41b7-931d-719fdaf48c23 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:29.537204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89ccf-2e3c-41b7-931d-719fdaf48c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:29.537919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb89ccf-2e3c-41b7-931d-719fdaf48c23 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2, user.id=40c702c2349e41b28fd8d95f8c574439) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:29.538222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb89ccf-2e3c-41b7-931d-719fdaf48c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:29.539649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb89ccf-2e3c-41b7-931d-719fdaf48c23 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:29.545264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 559/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:29 2022] GET /identity/v3/role_assignments?user.id=40c702c2349e41b28fd8d95f8c574439&scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:31.443411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf25aed-1a59-42fe-877d-bd3b826fe55a None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:31.443946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf25aed-1a59-42fe-877d-bd3b826fe55a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:31.443946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf25aed-1a59-42fe-877d-bd3b826fe55a None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:31.445311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 548/1107] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:18:31.450328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfb72f-6bd5-4494-8d58-9f57e7a7f7b3 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:31.450702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfb72f-6bd5-4494-8d58-9f57e7a7f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:31.450876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfb72f-6bd5-4494-8d58-9f57e7a7f7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:31.468545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-bbdfb72f-6bd5-4494-8d58-9f57e7a7f7b3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:31.469714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bbdfb72f-6bd5-4494-8d58-9f57e7a7f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:31.534679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 560/1108] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:31.805517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf25aed-1a59-42fe-877d-bd3b826fe55a None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:31.827209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:31.904458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf25aed-1a59-42fe-877d-bd3b826fe55a None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:31.936637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008872b-6099-44b6-b555-3ed7638f5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:31.937245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008872b-6099-44b6-b555-3ed7638f5967 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:31.937523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008872b-6099-44b6-b555-3ed7638f5967 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:31.937790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008872b-6099-44b6-b555-3ed7638f5967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:31.938885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008872b-6099-44b6-b555-3ed7638f5967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:31.940313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008872b-6099-44b6-b555-3ed7638f5967 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:31.942399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 549/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:31.947972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfb72f-6bd5-4494-8d58-9f57e7a7f7b3 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:31.962143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:32.044248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfb72f-6bd5-4494-8d58-9f57e7a7f7b3 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:32.078550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69ca4d-1040-4de7-b92a-8377f5c240c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:32.078974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69ca4d-1040-4de7-b92a-8377f5c240c0 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:32.079261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69ca4d-1040-4de7-b92a-8377f5c240c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:32.079624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69ca4d-1040-4de7-b92a-8377f5c240c0 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:32.080336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69ca4d-1040-4de7-b92a-8377f5c240c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:32.082055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69ca4d-1040-4de7-b92a-8377f5c240c0 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:32.103477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 561/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:18:31 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:18:34.007331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d8ce2-8609-450e-b8ad-d93c0b3b5607 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:34.007884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d8ce2-8609-450e-b8ad-d93c0b3b5607 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:34.007884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d8ce2-8609-450e-b8ad-d93c0b3b5607 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:34.009233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 550/1111] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:34.014265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09663154-1c90-4300-95b9-71e9f5e50d58 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:34.014675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09663154-1c90-4300-95b9-71e9f5e50d58 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:34.014819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09663154-1c90-4300-95b9-71e9f5e50d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:34.033495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-09663154-1c90-4300-95b9-71e9f5e50d58 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:34.034712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-09663154-1c90-4300-95b9-71e9f5e50d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:34.095293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:34.101312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 562/1112] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:34.371316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d8ce2-8609-450e-b8ad-d93c0b3b5607 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:34.457386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:34.470632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d8ce2-8609-450e-b8ad-d93c0b3b5607 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:34.504561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:34.505163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:34.505433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:34.505694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] PATH_INFO: `/v3/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:34.507057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] RBAC: Authorizing `identity:get_role(role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:34.508452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:34.509749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 551/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:34 2022] GET /identity/v3/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:34.515582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09663154-1c90-4300-95b9-71e9f5e50d58 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:34.610905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09663154-1c90-4300-95b9-71e9f5e50d58 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:34.643507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:34.644067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:34.644346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:34.644648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] PATH_INFO: `/v3/users/75d087aae7734f4091b17cdd46235cc1` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:34.657150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] RBAC: Authorizing `identity:get_user(user_id=75d087aae7734f4091b17cdd46235cc1)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:34.658594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:34.660840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 563/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:34 2022] GET /identity/v3/users/75d087aae7734f4091b17cdd46235cc1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:34.666575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:34.761597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669f7f5-1344-4d90-bdfa-b3a788c828ce None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:34.793761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:34.794337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:34.794609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:34.794873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:34.818303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:34.859170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:34.860607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:34.952747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 552/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:34.959145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:35.013681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:35.055923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e6c5-0a85-4c9f-89c0-684161667618 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:35.093152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc23def-93ba-4285-86a4-681be879857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:35.093771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23def-93ba-4285-86a4-681be879857f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:35.094046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23def-93ba-4285-86a4-681be879857f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:35.094315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23def-93ba-4285-86a4-681be879857f None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:35.095403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc23def-93ba-4285-86a4-681be879857f None admin] RBAC: Authorizing `identity:get_project(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:35.096894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc23def-93ba-4285-86a4-681be879857f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:35.098537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 564/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:34 2022] GET /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:35.104879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:35.162052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:35.204301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a538a4-57bf-4519-96e7-3a0bdf21ebc3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:35.236111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff526b-041c-4a01-968a-e9b185d0f319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:35.236717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff526b-041c-4a01-968a-e9b185d0f319 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:35.236988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff526b-041c-4a01-968a-e9b185d0f319 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:35.237251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff526b-041c-4a01-968a-e9b185d0f319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:35.238465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff526b-041c-4a01-968a-e9b185d0f319 None admin] RBAC: Adding query filter params (role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2, user.id=75d087aae7734f4091b17cdd46235cc1) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:35.238763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff526b-041c-4a01-968a-e9b185d0f319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:35.240171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff526b-041c-4a01-968a-e9b185d0f319 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:35.245305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 553/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:35 2022] GET /identity/v3/role_assignments?user.id=75d087aae7734f4091b17cdd46235cc1&scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:37.094104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8f660-fae5-4a31-ae66-f2ad5b09df8e None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:37.094685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8f660-fae5-4a31-ae66-f2ad5b09df8e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:37.094685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8f660-fae5-4a31-ae66-f2ad5b09df8e None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:37.096007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 565/1118] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:37.101044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c9927-4604-4c7a-b33a-db96f88825e9 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:37.101442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c9927-4604-4c7a-b33a-db96f88825e9 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:37.101579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c9927-4604-4c7a-b33a-db96f88825e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:37.119378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-074c9927-4604-4c7a-b33a-db96f88825e9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:37.120579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-074c9927-4604-4c7a-b33a-db96f88825e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:37.184143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 554/1119] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:37.447314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8f660-fae5-4a31-ae66-f2ad5b09df8e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:37.546951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8f660-fae5-4a31-ae66-f2ad5b09df8e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:37.569741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:37.580308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:37.580961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:37.581238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:37.581507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] PATH_INFO: `/v3/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:37.583418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] RBAC: Authorizing `identity:get_role(role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:37.584825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:37.586134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 566/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:37 2022] GET /identity/v3/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:37.591984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c9927-4604-4c7a-b33a-db96f88825e9 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:37.644996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:37.693434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c9927-4604-4c7a-b33a-db96f88825e9 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:37.730971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:37.731526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:37.731805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:37.732078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] PATH_INFO: `/v3/users/75d087aae7734f4091b17cdd46235cc1` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:37.733215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] RBAC: Authorizing `identity:get_user(user_id=75d087aae7734f4091b17cdd46235cc1)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:37.734661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:37.736247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 555/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:37 2022] GET /identity/v3/users/75d087aae7734f4091b17cdd46235cc1 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:37.742010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:37.837564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463807-586b-4d60-9d90-e8622e3b4552 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:37.869784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00831-98dc-42ec-b9a5-484ceb5faaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:37.870402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00831-98dc-42ec-b9a5-484ceb5faaa7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:37.870682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00831-98dc-42ec-b9a5-484ceb5faaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:37.870948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00831-98dc-42ec-b9a5-484ceb5faaa7 None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:37.872045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00831-98dc-42ec-b9a5-484ceb5faaa7 None admin] RBAC: Authorizing `identity:get_project(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:37.873506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00831-98dc-42ec-b9a5-484ceb5faaa7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:37.875105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 567/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:37 2022] GET /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:37.881453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:37.985683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953b3d5-a543-429a-b511-f759b8858778 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:38.010719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:38.029928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da399d-666d-4b27-8e22-147cfd7e3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:38.030568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da399d-666d-4b27-8e22-147cfd7e3be8 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:38.030838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da399d-666d-4b27-8e22-147cfd7e3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:38.031104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da399d-666d-4b27-8e22-147cfd7e3be8 None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2/users/75d087aae7734f4091b17cdd46235cc1/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:38.033200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da399d-666d-4b27-8e22-147cfd7e3be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2, user_id=75d087aae7734f4091b17cdd46235cc1, role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:38.034622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da399d-666d-4b27-8e22-147cfd7e3be8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:38.046433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 556/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:18:37 2022] PUT /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2/users/75d087aae7734f4091b17cdd46235cc1/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:18:39.916686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cd00-5cc5-4cc8-8e33-6d23686f0988 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:39.917199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cd00-5cc5-4cc8-8e33-6d23686f0988 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:39.917199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cd00-5cc5-4cc8-8e33-6d23686f0988 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:39.918456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 568/1124] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:39.923571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337422-3e8b-4ecb-b05f-cc87a27b41cb None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:39.923962 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337422-3e8b-4ecb-b05f-cc87a27b41cb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:39.924114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337422-3e8b-4ecb-b05f-cc87a27b41cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:39.942428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d4337422-3e8b-4ecb-b05f-cc87a27b41cb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:39.943598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d4337422-3e8b-4ecb-b05f-cc87a27b41cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:40.007218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 557/1125] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:40.270935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872cd00-5cc5-4cc8-8e33-6d23686f0988 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:40.329294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:40.369844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872cd00-5cc5-4cc8-8e33-6d23686f0988 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:40.402436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:40.403044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:40.403316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:40.403582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] PATH_INFO: `/v3/roles/d87742ff7342495d9bb18e91e1cdac23` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:40.404960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] RBAC: Authorizing `identity:get_role(role_id=d87742ff7342495d9bb18e91e1cdac23)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:40.406325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:40.407599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 569/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:40 2022] GET /identity/v3/roles/d87742ff7342495d9bb18e91e1cdac23 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:40.413849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337422-3e8b-4ecb-b05f-cc87a27b41cb None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:40.512824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337422-3e8b-4ecb-b05f-cc87a27b41cb None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:40.522580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:40.548354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:40.549001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:40.549278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:40.549550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] PATH_INFO: `/v3/users/75d087aae7734f4091b17cdd46235cc1` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:40.550692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] RBAC: Authorizing `identity:get_user(user_id=75d087aae7734f4091b17cdd46235cc1)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:40.552126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:40.553750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 558/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:40 2022] GET /identity/v3/users/75d087aae7734f4091b17cdd46235cc1 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:40.559515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:40.659126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b2cd-75a4-46d9-8bad-2f6f83e4ce75 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:40.684089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:40.692575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:40.693170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:40.693442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:40.693705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:40.757973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:40.759405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:40.852734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 570/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:40.858861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:40.956052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b8823-95e0-43d5-a9a1-d3cc04307a1f None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:40.990340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5c439-409b-4766-b854-4af9d11e1bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:40.990976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5c439-409b-4766-b854-4af9d11e1bcf None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:40.991249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5c439-409b-4766-b854-4af9d11e1bcf None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:40.991516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5c439-409b-4766-b854-4af9d11e1bcf None admin] PATH_INFO: `/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:40.992661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5c439-409b-4766-b854-4af9d11e1bcf None admin] RBAC: Authorizing `identity:get_project(project_id=4463d1f10bf74cdc8df9b408f3fe8ed2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:40.994100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5c439-409b-4766-b854-4af9d11e1bcf None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:40.995735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 559/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:40 2022] GET /identity/v3/projects/4463d1f10bf74cdc8df9b408f3fe8ed2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:41.001909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:41.028935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:41.097700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33db06-b9cd-420d-a454-5e5aa5aa8cf2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:41.130786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b2be2-fefd-48e5-9d2a-e49e33c63f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:41.131313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2be2-fefd-48e5-9d2a-e49e33c63f01 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:41.131587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2be2-fefd-48e5-9d2a-e49e33c63f01 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:41.131854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2be2-fefd-48e5-9d2a-e49e33c63f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:41.132588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b2be2-fefd-48e5-9d2a-e49e33c63f01 None admin] RBAC: Adding query filter params (role.id=d87742ff7342495d9bb18e91e1cdac23, scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2, user.id=75d087aae7734f4091b17cdd46235cc1) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:41.132893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b2be2-fefd-48e5-9d2a-e49e33c63f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:41.134301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b2be2-fefd-48e5-9d2a-e49e33c63f01 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:41.139852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 571/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:41 2022] GET /identity/v3/role_assignments?user.id=75d087aae7734f4091b17cdd46235cc1&scope.project.id=4463d1f10bf74cdc8df9b408f3fe8ed2&role.id=d87742ff7342495d9bb18e91e1cdac23 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:43.024020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873656-ffcd-42df-9c12-2b49a30129ab None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:43.024592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873656-ffcd-42df-9c12-2b49a30129ab None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:43.024592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873656-ffcd-42df-9c12-2b49a30129ab None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:43.025916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 560/1131] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:43.031374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53ca3-281a-4ceb-b21b-37ead392655d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:43.031758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53ca3-281a-4ceb-b21b-37ead392655d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:43.031926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53ca3-281a-4ceb-b21b-37ead392655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:43.050708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1ca53ca3-281a-4ceb-b21b-37ead392655d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:43.051880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1ca53ca3-281a-4ceb-b21b-37ead392655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:43.116201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 572/1132] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:43.381307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873656-ffcd-42df-9c12-2b49a30129ab None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:43.427280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:43.480285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873656-ffcd-42df-9c12-2b49a30129ab None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:43.513588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb5b6-b8c2-41a8-b604-7fe4eecedc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:43.514208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb5b6-b8c2-41a8-b604-7fe4eecedc08 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:43.514485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb5b6-b8c2-41a8-b604-7fe4eecedc08 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:43.514754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb5b6-b8c2-41a8-b604-7fe4eecedc08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:43.515855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb5b6-b8c2-41a8-b604-7fe4eecedc08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:43.517322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb5b6-b8c2-41a8-b604-7fe4eecedc08 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:43.518920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 561/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:43.524625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca53ca3-281a-4ceb-b21b-37ead392655d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:43.547408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:43.621143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca53ca3-281a-4ceb-b21b-37ead392655d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:43.653457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79a503-3435-4016-91e1-63c327398914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:43.654016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a503-3435-4016-91e1-63c327398914 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:43.654286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a503-3435-4016-91e1-63c327398914 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:43.654549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a503-3435-4016-91e1-63c327398914 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:43.655180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79a503-3435-4016-91e1-63c327398914 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:43.656613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79a503-3435-4016-91e1-63c327398914 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:43.683089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 573/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:18:43 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:18:45.582028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba06b8-4cc3-402b-a3b8-95c9e672fec5 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:45.582510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba06b8-4cc3-402b-a3b8-95c9e672fec5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:45.582604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba06b8-4cc3-402b-a3b8-95c9e672fec5 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:45.583901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 562/1135] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:45.589054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc443-8026-49fc-865f-f34e3afe66db None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:45.589415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc443-8026-49fc-865f-f34e3afe66db None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:45.589605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc443-8026-49fc-865f-f34e3afe66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:45.608102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c60cc443-8026-49fc-865f-f34e3afe66db None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:45.609309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c60cc443-8026-49fc-865f-f34e3afe66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:45.673083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 574/1136] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:45.938861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba06b8-4cc3-402b-a3b8-95c9e672fec5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:46.037360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba06b8-4cc3-402b-a3b8-95c9e672fec5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:46.049857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:46.070683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543216b-9737-4f08-9974-ca0c2b8d3300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:46.071296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543216b-9737-4f08-9974-ca0c2b8d3300 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:46.071572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543216b-9737-4f08-9974-ca0c2b8d3300 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:46.071846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543216b-9737-4f08-9974-ca0c2b8d3300 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:46.072976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543216b-9737-4f08-9974-ca0c2b8d3300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:46.074403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543216b-9737-4f08-9974-ca0c2b8d3300 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:46.075966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 563/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:18:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:46.082566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cc443-8026-49fc-865f-f34e3afe66db None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:46.085695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:46.178571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cc443-8026-49fc-865f-f34e3afe66db None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:46.211923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749395a-b7b7-4eb4-b52a-347d00c811e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:46.212486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749395a-b7b7-4eb4-b52a-347d00c811e4 None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:46.212766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749395a-b7b7-4eb4-b52a-347d00c811e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:46.213040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749395a-b7b7-4eb4-b52a-347d00c811e4 None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:46.213679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749395a-b7b7-4eb4-b52a-347d00c811e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:46.215111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749395a-b7b7-4eb4-b52a-347d00c811e4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:46.235312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 575/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:18:46 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:18:48.141677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85dbe-76ae-41e4-8f1a-d8af73facd74 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:48.142238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85dbe-76ae-41e4-8f1a-d8af73facd74 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:48.142238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85dbe-76ae-41e4-8f1a-d8af73facd74 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:48.143540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 564/1139] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:48.149196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e4f72-13e2-4916-984d-3d0254e6b71d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:48.149610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e4f72-13e2-4916-984d-3d0254e6b71d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:48.149727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e4f72-13e2-4916-984d-3d0254e6b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:48.167355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d52e4f72-13e2-4916-984d-3d0254e6b71d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:48.168557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d52e4f72-13e2-4916-984d-3d0254e6b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:48.222488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:48.234523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 576/1140] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:48.503139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85dbe-76ae-41e4-8f1a-d8af73facd74 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:48.603393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85dbe-76ae-41e4-8f1a-d8af73facd74 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:48.635268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:48.635881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:48.636155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:48.636446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:48.646550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:48.651303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:48.652506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:48.653608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 565/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:18:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:48.658307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e4f72-13e2-4916-984d-3d0254e6b71d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:48.752647 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e4f72-13e2-4916-984d-3d0254e6b71d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:48.785038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:48.785573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:48.785850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:48.786121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:48.786774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:48.787074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:48.788463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:48.796333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 577/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:48.802451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:48.843041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:48.898848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4bd13-266c-4503-8931-aac85a54d9e6 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:48.930973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:48.931567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:48.931839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:48.932101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] PATH_INFO: `/v3/users/6d6757ec8d3642ecab6521356cf18ee2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:48.944987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] RBAC: Authorizing `identity:get_user(user_id=6d6757ec8d3642ecab6521356cf18ee2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:48.946400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:48.947935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 566/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:48 2022] GET /identity/v3/users/6d6757ec8d3642ecab6521356cf18ee2 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:48.953657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:49.004643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:49.051588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c05bf4-c504-4d5d-8967-61a04bebf07e None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:49.085622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:49.086445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:49.086841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:49.087224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:49.158470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:49.159924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:49.209339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:49.255616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 578/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:49.261511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:49.352635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:49.356791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84c19-a330-4066-933d-bfcdd39da31c None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:49.392189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a6c1-91d7-43b1-b177-928e25df7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:49.392822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a6c1-91d7-43b1-b177-928e25df7958 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:49.393097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a6c1-91d7-43b1-b177-928e25df7958 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:49.393363 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a6c1-91d7-43b1-b177-928e25df7958 None admin] PATH_INFO: `/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:49.394492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a6c1-91d7-43b1-b177-928e25df7958 None admin] RBAC: Authorizing `identity:get_project(project_id=4be4ebe09aab4a76aeb43561aed6fdf9)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:49.395919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a6c1-91d7-43b1-b177-928e25df7958 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:49.397567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 567/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:49 2022] GET /identity/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:49.403890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:49.499991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f24e-bd01-4803-a13a-0e5708fbf7e8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:49.535610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed636b-8e4c-4799-a415-910ef21c3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:49.536218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed636b-8e4c-4799-a415-910ef21c3f02 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:49.536607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed636b-8e4c-4799-a415-910ef21c3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:49.536883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed636b-8e4c-4799-a415-910ef21c3f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:49.537607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed636b-8e4c-4799-a415-910ef21c3f02 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=4be4ebe09aab4a76aeb43561aed6fdf9, user.id=6d6757ec8d3642ecab6521356cf18ee2) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:49.537913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed636b-8e4c-4799-a415-910ef21c3f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:49.539336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed636b-8e4c-4799-a415-910ef21c3f02 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:49.544577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 579/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:49 2022] GET /identity/v3/role_assignments?user.id=6d6757ec8d3642ecab6521356cf18ee2&scope.project.id=4be4ebe09aab4a76aeb43561aed6fdf9&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:51.388024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57ac35-a30c-40c5-bde8-1832bfe114cd None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:51.388585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57ac35-a30c-40c5-bde8-1832bfe114cd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:51.388585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57ac35-a30c-40c5-bde8-1832bfe114cd None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:51.389946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 568/1147] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:51.395510 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1af41-57e0-4b00-84db-8bd9a1fc2d8e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:51.395879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1af41-57e0-4b00-84db-8bd9a1fc2d8e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:51.396065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1af41-57e0-4b00-84db-8bd9a1fc2d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:51.413715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c5f1af41-57e0-4b00-84db-8bd9a1fc2d8e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:51.414887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c5f1af41-57e0-4b00-84db-8bd9a1fc2d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:51.425186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:51.479775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 580/1148] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:51.743589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57ac35-a30c-40c5-bde8-1832bfe114cd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:51.842268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57ac35-a30c-40c5-bde8-1832bfe114cd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:51.875527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:51.876140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:51.876432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:51.876707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:51.886394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:51.891154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:51.892237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:51.893183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 569/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:51.898229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1af41-57e0-4b00-84db-8bd9a1fc2d8e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:51.992619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1af41-57e0-4b00-84db-8bd9a1fc2d8e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:52.024181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:52.024732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:52.025006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:52.025274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:52.025920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:52.026219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:52.027581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:52.035701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 581/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:52.041234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:52.068991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:52.144728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fa49-2f01-43d7-838e-19ff762edc83 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:52.178377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:52.178990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:52.179263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:52.179530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] PATH_INFO: `/v3/users/6d6757ec8d3642ecab6521356cf18ee2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:52.180656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] RBAC: Authorizing `identity:get_user(user_id=6d6757ec8d3642ecab6521356cf18ee2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:52.182086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:52.183641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 570/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:52 2022] GET /identity/v3/users/6d6757ec8d3642ecab6521356cf18ee2 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:52.189460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:52.200619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:52.287822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51134-0dec-4a06-a8ad-d954c6595269 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:52.319691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a2290-ea62-4edb-af07-6da05f0462fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:52.320314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2290-ea62-4edb-af07-6da05f0462fc None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:52.320623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2290-ea62-4edb-af07-6da05f0462fc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:52.320896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2290-ea62-4edb-af07-6da05f0462fc None admin] PATH_INFO: `/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:52.321997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a2290-ea62-4edb-af07-6da05f0462fc None admin] RBAC: Authorizing `identity:get_project(project_id=4be4ebe09aab4a76aeb43561aed6fdf9)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:52.323435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a2290-ea62-4edb-af07-6da05f0462fc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:52.325074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 582/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:52 2022] GET /identity/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:18:52.330776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:52.426656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:52.434290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dafb53-82b7-4c34-8250-eac3ebd29d8b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:52.466932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9348df9-f141-45a5-b9df-71b27a54f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:52.467571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348df9-f141-45a5-b9df-71b27a54f571 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:52.467844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348df9-f141-45a5-b9df-71b27a54f571 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:52.468111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348df9-f141-45a5-b9df-71b27a54f571 None admin] PATH_INFO: `/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9/users/6d6757ec8d3642ecab6521356cf18ee2/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:52.469993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9348df9-f141-45a5-b9df-71b27a54f571 None admin] RBAC: Authorizing `identity:create_grant(project_id=4be4ebe09aab4a76aeb43561aed6fdf9, user_id=6d6757ec8d3642ecab6521356cf18ee2, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:52.471403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9348df9-f141-45a5-b9df-71b27a54f571 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:52.485226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 571/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:18:52 2022] PUT /identity/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9/users/6d6757ec8d3642ecab6521356cf18ee2/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:18:54.352067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4968559-0eb3-486f-9aa7-952bca65386e None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:54.353003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4968559-0eb3-486f-9aa7-952bca65386e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:54.353003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4968559-0eb3-486f-9aa7-952bca65386e None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:54.354230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 583/1154] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:54.359349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de395-12e5-486c-9db4-ccb2db912c75 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:54.359759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de395-12e5-486c-9db4-ccb2db912c75 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:54.359888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de395-12e5-486c-9db4-ccb2db912c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:54.378829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7e0de395-12e5-486c-9db4-ccb2db912c75 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:54.379999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7e0de395-12e5-486c-9db4-ccb2db912c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:54.444634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 572/1155] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:54.716097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4968559-0eb3-486f-9aa7-952bca65386e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:54.790854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:54.813665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4968559-0eb3-486f-9aa7-952bca65386e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:54.845482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:54.846086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:54.846363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:54.847153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:54.858163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:18:54.863432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:54.864564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:18:54.865612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 584/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:54.870521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de395-12e5-486c-9db4-ccb2db912c75 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:54.949976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:54.966232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de395-12e5-486c-9db4-ccb2db912c75 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:54.999784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:55.000398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:55.000683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:55.000953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:55.001607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:55.001903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:55.003295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:55.011159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 573/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:55.017091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:55.115820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8559-c124-457f-ad6c-362df747c694 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:55.148518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:55.149137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:55.149415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:55.149687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] PATH_INFO: `/v3/users/6d6757ec8d3642ecab6521356cf18ee2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:55.150827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=6d6757ec8d3642ecab6521356cf18ee2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:55.152293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:55.153892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 585/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:18:55 2022] GET /identity/v3/users/6d6757ec8d3642ecab6521356cf18ee2 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:55.160224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:55.255938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b6255-cc59-4927-ba2a-0d44dccea987 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:55.287896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:55.288508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:55.288787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:55.289055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:55.303908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:55.353863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:55.355293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:55.449035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 574/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:55.454788 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:55.458652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:55.551085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a1e9-c8c7-40f5-bca2-bfb537d61bc7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:55.583397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4271a4-5483-47f5-9df0-ee8490c99f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:55.584017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4271a4-5483-47f5-9df0-ee8490c99f9f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:55.584296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4271a4-5483-47f5-9df0-ee8490c99f9f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:55.584595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4271a4-5483-47f5-9df0-ee8490c99f9f None admin] PATH_INFO: `/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:55.585697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4271a4-5483-47f5-9df0-ee8490c99f9f None admin] RBAC: Authorizing `identity:get_project(project_id=4be4ebe09aab4a76aeb43561aed6fdf9)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:55.587125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4271a4-5483-47f5-9df0-ee8490c99f9f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:55.588762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 586/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:18:55 2022] GET /identity/v3/projects/4be4ebe09aab4a76aeb43561aed6fdf9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:55.594779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:55.640638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:55.691682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4585-ac71-4c5d-81c8-3a1d1fc3d7a2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:55.724005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c5d82-61c4-46ac-bccf-cd3408575f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:55.724625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c5d82-61c4-46ac-bccf-cd3408575f24 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:55.724899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c5d82-61c4-46ac-bccf-cd3408575f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:55.725169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c5d82-61c4-46ac-bccf-cd3408575f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:55.725878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c5d82-61c4-46ac-bccf-cd3408575f24 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=4be4ebe09aab4a76aeb43561aed6fdf9, user.id=6d6757ec8d3642ecab6521356cf18ee2) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:55.726181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c5d82-61c4-46ac-bccf-cd3408575f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:55.727605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c5d82-61c4-46ac-bccf-cd3408575f24 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:55.733446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 575/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:18:55 2022] GET /identity/v3/role_assignments?user.id=6d6757ec8d3642ecab6521356cf18ee2&scope.project.id=4be4ebe09aab4a76aeb43561aed6fdf9&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:18:57.616271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749410-0b2b-4aa3-8e27-c676f0197dee None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:57.616771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749410-0b2b-4aa3-8e27-c676f0197dee None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:57.616862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749410-0b2b-4aa3-8e27-c676f0197dee None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:57.618167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 587/1162] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:18:57.623289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269186c-29d9-46c1-9398-729ae8f76ef0 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:57.623719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269186c-29d9-46c1-9398-729ae8f76ef0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:57.623820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269186c-29d9-46c1-9398-729ae8f76ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:57.641483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4269186c-29d9-46c1-9398-729ae8f76ef0 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:18:57.642659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4269186c-29d9-46c1-9398-729ae8f76ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:18:57.707708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 576/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:18:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:18:57.972513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749410-0b2b-4aa3-8e27-c676f0197dee None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:58.040733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:58.070145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749410-0b2b-4aa3-8e27-c676f0197dee None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:58.101884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:58.102482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:58.103013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:58.103285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:58.167347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:58.168824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:58.234608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:58.263785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 588/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:18:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:18:58.270204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269186c-29d9-46c1-9398-729ae8f76ef0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:58.309861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:18:58.366079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269186c-29d9-46c1-9398-729ae8f76ef0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:58.398737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4a6ed-bfb8-4836-9ce8-07647b7b5933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:58.399351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4a6ed-bfb8-4836-9ce8-07647b7b5933 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:58.399627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4a6ed-bfb8-4836-9ce8-07647b7b5933 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:58.399897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4a6ed-bfb8-4836-9ce8-07647b7b5933 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:58.407982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4a6ed-bfb8-4836-9ce8-07647b7b5933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:58.410032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4a6ed-bfb8-4836-9ce8-07647b7b5933 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-fcd4a6ed-bfb8-4836-9ce8-07647b7b5933 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:18:58.421021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:18:58.422212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:18:58.423452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 577/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:18:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:18:58.428079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:18:58.526259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315779a-a193-45f2-809d-f879fc2a6e07 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:18:58.559162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce852779-8b9f-4629-8c46-552be0ea4929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:18:58.559756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852779-8b9f-4629-8c46-552be0ea4929 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:18:58.560029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852779-8b9f-4629-8c46-552be0ea4929 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:18:58.560296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852779-8b9f-4629-8c46-552be0ea4929 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:18:58.560955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce852779-8b9f-4629-8c46-552be0ea4929 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:18:58.561250 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce852779-8b9f-4629-8c46-552be0ea4929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:18:58.562612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce852779-8b9f-4629-8c46-552be0ea4929 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:18:58.570052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 589/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Sep 1 00:18:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:00.437133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea923b2-721c-432d-a03e-06f55a53582b None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:00.437662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea923b2-721c-432d-a03e-06f55a53582b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:00.437662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea923b2-721c-432d-a03e-06f55a53582b None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:00.438990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 578/1167] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:19:00.444665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679528b3-c27f-44a1-98aa-c7530987b18d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:00.445043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679528b3-c27f-44a1-98aa-c7530987b18d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:00.445208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679528b3-c27f-44a1-98aa-c7530987b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:00.464082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-679528b3-c27f-44a1-98aa-c7530987b18d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:19:00.465275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-679528b3-c27f-44a1-98aa-c7530987b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:19:00.492964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:00.529657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 590/1168] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:19:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:19:00.796565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea923b2-721c-432d-a03e-06f55a53582b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:00.892035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:00.896241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea923b2-721c-432d-a03e-06f55a53582b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:00.929607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414faa5-ae27-4ab2-8467-f5f958100feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:00.930197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414faa5-ae27-4ab2-8467-f5f958100feb None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:00.930472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414faa5-ae27-4ab2-8467-f5f958100feb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:00.930743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414faa5-ae27-4ab2-8467-f5f958100feb None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:00.931406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414faa5-ae27-4ab2-8467-f5f958100feb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:00.932817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414faa5-ae27-4ab2-8467-f5f958100feb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:00.949267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 579/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Thu Sep 1 00:19:00 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:19:02.834621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2975a-a3fe-46f4-8357-d04e8ec7e84a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:02.835135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2975a-a3fe-46f4-8357-d04e8ec7e84a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:02.835135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2975a-a3fe-46f4-8357-d04e8ec7e84a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:02.836427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 591/1170] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:19:02.841476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883b45-db96-45f0-ba06-6659ad746a8c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:02.841856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883b45-db96-45f0-ba06-6659ad746a8c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:02.842023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883b45-db96-45f0-ba06-6659ad746a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:02.860486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ab883b45-db96-45f0-ba06-6659ad746a8c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:19:02.861660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ab883b45-db96-45f0-ba06-6659ad746a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:19:02.925507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 580/1171] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:19:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:19:03.190634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2975a-a3fe-46f4-8357-d04e8ec7e84a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:03.287875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2975a-a3fe-46f4-8357-d04e8ec7e84a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:03.320029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e30d2f-aa1a-4ab8-8c7e-94e42c6d79f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:03.320669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e30d2f-aa1a-4ab8-8c7e-94e42c6d79f1 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:03.320943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e30d2f-aa1a-4ab8-8c7e-94e42c6d79f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:03.321211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e30d2f-aa1a-4ab8-8c7e-94e42c6d79f1 None admin] PATH_INFO: `/v3/domains/8aaa78eaa4574c948f1a8058b73392a5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:03.333033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e30d2f-aa1a-4ab8-8c7e-94e42c6d79f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8aaa78eaa4574c948f1a8058b73392a5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:03.334496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e30d2f-aa1a-4ab8-8c7e-94e42c6d79f1 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:03.336251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 592/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Sep 1 00:19:03 2022] GET /identity/v3/domains/8aaa78eaa4574c948f1a8058b73392a5 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:03.342227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883b45-db96-45f0-ba06-6659ad746a8c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:03.427384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:03.437448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883b45-db96-45f0-ba06-6659ad746a8c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:03.471293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd49f-f7ef-4e28-a464-dd53f0e99034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:03.471816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd49f-f7ef-4e28-a464-dd53f0e99034 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:03.472090 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd49f-f7ef-4e28-a464-dd53f0e99034 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:03.472356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd49f-f7ef-4e28-a464-dd53f0e99034 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:03.473029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd49f-f7ef-4e28-a464-dd53f0e99034 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:03.474438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd49f-f7ef-4e28-a464-dd53f0e99034 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:03.499975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 581/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:19:03 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:19:05.407515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8f7b6-6b67-42b0-989a-251a27817b99 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:05.408046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8f7b6-6b67-42b0-989a-251a27817b99 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:05.408046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8f7b6-6b67-42b0-989a-251a27817b99 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:05.409960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 593/1174] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:19:05.415061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de3e8-5802-4179-b7cd-c227d5e2da12 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:05.415474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de3e8-5802-4179-b7cd-c227d5e2da12 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:05.415585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de3e8-5802-4179-b7cd-c227d5e2da12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:05.433965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e58de3e8-5802-4179-b7cd-c227d5e2da12 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:19:05.435141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e58de3e8-5802-4179-b7cd-c227d5e2da12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:19:05.499905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 582/1175] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:19:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:19:05.765826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8f7b6-6b67-42b0-989a-251a27817b99 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:05.793840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:05.866177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8f7b6-6b67-42b0-989a-251a27817b99 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:05.898853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4988fb2-e48d-4ef6-ba99-71f04d61471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:05.899464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4988fb2-e48d-4ef6-ba99-71f04d61471c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:05.899737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4988fb2-e48d-4ef6-ba99-71f04d61471c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:05.900001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4988fb2-e48d-4ef6-ba99-71f04d61471c None admin] PATH_INFO: `/v3/domains/8aaa78eaa4574c948f1a8058b73392a5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:05.901112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4988fb2-e48d-4ef6-ba99-71f04d61471c None admin] RBAC: Authorizing `identity:get_domain(domain_id=8aaa78eaa4574c948f1a8058b73392a5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:05.902538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4988fb2-e48d-4ef6-ba99-71f04d61471c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:05.904064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 594/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Sep 1 00:19:05 2022] GET /identity/v3/domains/8aaa78eaa4574c948f1a8058b73392a5 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:05.910387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58de3e8-5802-4179-b7cd-c227d5e2da12 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:05.976882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:06.006036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58de3e8-5802-4179-b7cd-c227d5e2da12 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:06.038711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77265af5-eb49-4246-be57-19d80228a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:06.039243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77265af5-eb49-4246-be57-19d80228a0ca None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:06.039513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77265af5-eb49-4246-be57-19d80228a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:06.039778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77265af5-eb49-4246-be57-19d80228a0ca None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:06.040442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77265af5-eb49-4246-be57-19d80228a0ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:06.041851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77265af5-eb49-4246-be57-19d80228a0ca None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:06.062105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 583/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:19:05 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:19:07.992808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857a17d-c0e0-4317-8b6c-b92e189e26be None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:07.993404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857a17d-c0e0-4317-8b6c-b92e189e26be None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:07.993404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857a17d-c0e0-4317-8b6c-b92e189e26be None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:07.994687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 595/1178] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:19:07.999873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef7e3-bd22-49e0-a70d-185fa72e1cef None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:08.000372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef7e3-bd22-49e0-a70d-185fa72e1cef None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:08.000505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef7e3-bd22-49e0-a70d-185fa72e1cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:08.018841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-667ef7e3-bd22-49e0-a70d-185fa72e1cef None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:19:08.020024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-667ef7e3-bd22-49e0-a70d-185fa72e1cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:19:08.083841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 584/1179] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:19:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:19:08.349537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857a17d-c0e0-4317-8b6c-b92e189e26be None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:08.441995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:08.449715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857a17d-c0e0-4317-8b6c-b92e189e26be None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:08.483085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:08.483701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:08.483981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:08.484254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:08.495070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:19:08.499873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:19:08.501063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:19:08.502052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 596/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:19:08.507032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef7e3-bd22-49e0-a70d-185fa72e1cef None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:08.562283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:08.603052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef7e3-bd22-49e0-a70d-185fa72e1cef None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:08.641694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:08.642287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:08.642582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:08.643404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:08.644056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:19:08.644352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:08.645743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:08.654939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 585/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:08.660765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:08.758370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a4ebf-3e2d-4af9-a4d4-ed6cc6056944 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:08.789872 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:08.790481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:08.790760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:08.791033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] PATH_INFO: `/v3/users/19f4bf3a829247a9b6356a1f65d1708c` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:08.803995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] RBAC: Authorizing `identity:get_user(user_id=19f4bf3a829247a9b6356a1f65d1708c)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:08.805464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:08.807022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 597/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:19:08 2022] GET /identity/v3/users/19f4bf3a829247a9b6356a1f65d1708c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:08.812833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:08.908229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88de86-4b76-4414-8686-26784a6b649b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:08.927064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:08.940900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:08.941755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:08.942182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:08.942607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:09.015594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:09.017068 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:09.110969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 586/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:19:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:19:09.116908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:09.131646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:09.214275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248be6-b90a-4644-a557-e19ecc5e0d13 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:09.246164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287bbaf-3d95-4dbb-8037-6fc538b21aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:09.246765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287bbaf-3d95-4dbb-8037-6fc538b21aae None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:09.247039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287bbaf-3d95-4dbb-8037-6fc538b21aae None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:09.247306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287bbaf-3d95-4dbb-8037-6fc538b21aae None admin] PATH_INFO: `/v3/projects/86a7861ba4a649f59d82869544a42ba4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:09.248411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287bbaf-3d95-4dbb-8037-6fc538b21aae None admin] RBAC: Authorizing `identity:get_project(project_id=86a7861ba4a649f59d82869544a42ba4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:09.249830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287bbaf-3d95-4dbb-8037-6fc538b21aae None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:09.251406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 598/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:19:09 2022] GET /identity/v3/projects/86a7861ba4a649f59d82869544a42ba4 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:09.257871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:09.280933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:09.355467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c71466-32fc-4f73-b2e3-b4329487bf53 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:09.387637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053297fb-92da-47fb-98aa-33c2fd81f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:09.388216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053297fb-92da-47fb-98aa-33c2fd81f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:09.388513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053297fb-92da-47fb-98aa-33c2fd81f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:09.388780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053297fb-92da-47fb-98aa-33c2fd81f4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:09.389486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053297fb-92da-47fb-98aa-33c2fd81f4e4 None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=86a7861ba4a649f59d82869544a42ba4, user.id=19f4bf3a829247a9b6356a1f65d1708c) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:19:09.389785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053297fb-92da-47fb-98aa-33c2fd81f4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:09.391193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053297fb-92da-47fb-98aa-33c2fd81f4e4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:09.397036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 587/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:19:09 2022] GET /identity/v3/role_assignments?user.id=19f4bf3a829247a9b6356a1f65d1708c&scope.project.id=86a7861ba4a649f59d82869544a42ba4&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:11.252922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45910-c5fb-4ce3-8a12-d9cf8d5f2084 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:11.253502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45910-c5fb-4ce3-8a12-d9cf8d5f2084 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:11.253502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb45910-c5fb-4ce3-8a12-d9cf8d5f2084 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:11.254786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 599/1186] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:19:11.259941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7aae-ea2d-4ec5-905b-78caa51836db None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:11.260307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7aae-ea2d-4ec5-905b-78caa51836db None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:11.260510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7aae-ea2d-4ec5-905b-78caa51836db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:11.278565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-93bf7aae-ea2d-4ec5-905b-78caa51836db None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:19:11.279712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-93bf7aae-ea2d-4ec5-905b-78caa51836db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:19:11.343316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 588/1187] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:19:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:19:11.606598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb45910-c5fb-4ce3-8a12-d9cf8d5f2084 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:11.686691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:11.707371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb45910-c5fb-4ce3-8a12-d9cf8d5f2084 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:11.746281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:11.746916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:11.747196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:11.747469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:11.758046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:19:11.762850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:19:11.763952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:19:11.765055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 600/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:19:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:19:11.770201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf7aae-ea2d-4ec5-905b-78caa51836db None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:11.784841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:11.865118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf7aae-ea2d-4ec5-905b-78caa51836db None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:11.897785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:11.898366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:11.898638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:11.898902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:11.899655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:19:11.899947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:11.901332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:11.909879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 589/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:19:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:19:11.915778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:12.011434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa192ed-73a1-402e-b345-f37b0474ace7 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:12.044291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:12.044880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:12.045159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:12.045429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] PATH_INFO: `/v3/users/19f4bf3a829247a9b6356a1f65d1708c` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:12.046526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=19f4bf3a829247a9b6356a1f65d1708c)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:12.047956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:12.049557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 601/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:19:11 2022] GET /identity/v3/users/19f4bf3a829247a9b6356a1f65d1708c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:12.055173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:12.129348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:12.152103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45bcb5-b783-4b29-afe5-0a31c9dc0e60 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:12.183323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6838c-722b-4236-8682-bddbba9c572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:12.183925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6838c-722b-4236-8682-bddbba9c572b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:12.184196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6838c-722b-4236-8682-bddbba9c572b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:12.184489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6838c-722b-4236-8682-bddbba9c572b None admin] PATH_INFO: `/v3/projects/86a7861ba4a649f59d82869544a42ba4` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:12.185576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6838c-722b-4236-8682-bddbba9c572b None admin] RBAC: Authorizing `identity:get_project(project_id=86a7861ba4a649f59d82869544a42ba4)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:12.186994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6838c-722b-4236-8682-bddbba9c572b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:12.188599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 590/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:19:12 2022] GET /identity/v3/projects/86a7861ba4a649f59d82869544a42ba4 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:12.194847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:12.206011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:12.291690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b1875-9dd0-4200-9cd8-bfda87563ed5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:12.324187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c32f9-becc-4f89-97d6-bae24bdaf2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:12.324792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c32f9-becc-4f89-97d6-bae24bdaf2fc None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:12.325071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c32f9-becc-4f89-97d6-bae24bdaf2fc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:12.325342 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c32f9-becc-4f89-97d6-bae24bdaf2fc None admin] PATH_INFO: `/v3/projects/86a7861ba4a649f59d82869544a42ba4/users/19f4bf3a829247a9b6356a1f65d1708c/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:12.327210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c32f9-becc-4f89-97d6-bae24bdaf2fc None admin] RBAC: Authorizing `identity:create_grant(project_id=86a7861ba4a649f59d82869544a42ba4, user_id=19f4bf3a829247a9b6356a1f65d1708c, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:12.328661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c32f9-becc-4f89-97d6-bae24bdaf2fc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:12.349900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 602/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:19:12 2022] PUT /identity/v3/projects/86a7861ba4a649f59d82869544a42ba4/users/19f4bf3a829247a9b6356a1f65d1708c/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:19:14.209433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cba18-57eb-44fa-9edb-001c2cd8725d None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:14.209978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cba18-57eb-44fa-9edb-001c2cd8725d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:14.209978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cba18-57eb-44fa-9edb-001c2cd8725d None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:14.211284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 591/1193] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:19:14.216391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7317ae-e1a9-4f65-abb1-02d3dc504e97 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:14.216839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7317ae-e1a9-4f65-abb1-02d3dc504e97 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:14.216940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7317ae-e1a9-4f65-abb1-02d3dc504e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:14.235616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0c7317ae-e1a9-4f65-abb1-02d3dc504e97 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:19:14.236844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0c7317ae-e1a9-4f65-abb1-02d3dc504e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:19:14.296389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:14.302638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 603/1194] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:19:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:19:14.569389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cba18-57eb-44fa-9edb-001c2cd8725d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:14.667196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cba18-57eb-44fa-9edb-001c2cd8725d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:14.699315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:14.699914 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:14.700184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:14.700475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:14.711600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:19:14.716259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:19:14.717324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:19:14.718197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 592/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:19:14.723865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7317ae-e1a9-4f65-abb1-02d3dc504e97 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:14.817518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7317ae-e1a9-4f65-abb1-02d3dc504e97 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:14.850602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:14.851195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:14.851468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:14.851732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:14.852650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:19:14.852944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:14.854292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:14.861894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 604/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:14.867380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:14.870986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:14.962919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24445db7-e18a-482b-aa3d-2e4acde9299d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:15.002799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:15.003422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:15.003694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:15.003958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] PATH_INFO: `/v3/users/19f4bf3a829247a9b6356a1f65d1708c` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:15.005077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] RBAC: Authorizing `identity:get_user(user_id=19f4bf3a829247a9b6356a1f65d1708c)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:15.006508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:15.008082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 593/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Sep 1 00:19:14 2022] GET /identity/v3/users/19f4bf3a829247a9b6356a1f65d1708c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:19:15.013996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:15.071685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:15.112840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3aca9-eeac-4c91-bd80-3a385d475c3c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:15.144750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:15.145345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:15.145624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:15.145895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:15.210023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:15.211448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:15.266006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:15.306066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 605/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:19:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:19:15.311895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:15.383691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:15.412691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed296a6-8762-4790-9b44-b27781278f57 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:15.444236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d0afd-8f04-40a0-b6d9-45dd0f7ae620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:15.444873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0afd-8f04-40a0-b6d9-45dd0f7ae620 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:15.445144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0afd-8f04-40a0-b6d9-45dd0f7ae620 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:15.445410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0afd-8f04-40a0-b6d9-45dd0f7ae620 None admin] PATH_INFO: `/v3/projects/86a7861ba4a649f59d82869544a42ba4` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:15.446496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d0afd-8f04-40a0-b6d9-45dd0f7ae620 None admin] RBAC: Authorizing `identity:get_project(project_id=86a7861ba4a649f59d82869544a42ba4)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:15.447911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d0afd-8f04-40a0-b6d9-45dd0f7ae620 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:15.449551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 594/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Sep 1 00:19:15 2022] GET /identity/v3/projects/86a7861ba4a649f59d82869544a42ba4 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:15.456104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:19:15.551878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e413db-ad23-4d33-8d50-868480b8d015 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:19:15.584523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ebb12-0466-4643-9e24-71c0719fd7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:19:15.585125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ebb12-0466-4643-9e24-71c0719fd7db None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:19:15.585404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ebb12-0466-4643-9e24-71c0719fd7db None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:19:15.585674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ebb12-0466-4643-9e24-71c0719fd7db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:19:15.586434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ebb12-0466-4643-9e24-71c0719fd7db None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=86a7861ba4a649f59d82869544a42ba4, user.id=19f4bf3a829247a9b6356a1f65d1708c) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:19:15.586745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ebb12-0466-4643-9e24-71c0719fd7db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:19:15.588167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ebb12-0466-4643-9e24-71c0719fd7db None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:19:15.593775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 606/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:19:15 2022] GET /identity/v3/role_assignments?user.id=19f4bf3a829247a9b6356a1f65d1708c&scope.project.id=86a7861ba4a649f59d82869544a42ba4&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:19:25.440312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=30 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:19:25.591214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=88 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:10.469756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f138836-87d5-4426-9824-3b3093cc0af9 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:10.470394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f138836-87d5-4426-9824-3b3093cc0af9 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:10.470394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f138836-87d5-4426-9824-3b3093cc0af9 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:10.471878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 595/1201] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:10.477888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9880fe-40ba-4578-a3a0-1cb5cf06a374 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:10.478346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9880fe-40ba-4578-a3a0-1cb5cf06a374 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:10.478447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9880fe-40ba-4578-a3a0-1cb5cf06a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:10.500738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-bd9880fe-40ba-4578-a3a0-1cb5cf06a374 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:10.502001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bd9880fe-40ba-4578-a3a0-1cb5cf06a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:10.595838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 607/1202] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:10.914065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f138836-87d5-4426-9824-3b3093cc0af9 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:11.043142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f138836-87d5-4426-9824-3b3093cc0af9 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:11.088319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:11.089145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:11.089532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:11.089866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:11.103979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:11.105777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:11.124775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:11.126395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:11.127451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:11.127451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:11.127451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:11.132433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 596/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:11.132945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9880fe-40ba-4578-a3a0-1cb5cf06a374 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:11.265582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9880fe-40ba-4578-a3a0-1cb5cf06a374 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:11.301260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:11.308239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a6ebf-d98b-401d-a8e3-6be6585adffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:11.308935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6ebf-d98b-401d-a8e3-6be6585adffc None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:11.309212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6ebf-d98b-401d-a8e3-6be6585adffc None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:11.309511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6ebf-d98b-401d-a8e3-6be6585adffc None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:11.310259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6ebf-d98b-401d-a8e3-6be6585adffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:11.310584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6ebf-d98b-401d-a8e3-6be6585adffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:11.312154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6ebf-d98b-401d-a8e3-6be6585adffc None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:11.325857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 608/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:11.331696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:11.400415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:11.465295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf470-663f-4167-ba4f-4bf854478538 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:11.509035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0be70-53b6-4b79-8b30-9f8316fd2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:11.509988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0be70-53b6-4b79-8b30-9f8316fd2a0a None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:11.510274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0be70-53b6-4b79-8b30-9f8316fd2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:11.510552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0be70-53b6-4b79-8b30-9f8316fd2a0a None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:11.511214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0be70-53b6-4b79-8b30-9f8316fd2a0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:11.512843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0be70-53b6-4b79-8b30-9f8316fd2a0a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:11.540464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 597/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Sep 1 00:20:11 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:20:13.873939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae681-ffb5-4b85-9f7b-526d368876a7 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:13.874451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae681-ffb5-4b85-9f7b-526d368876a7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:13.874451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae681-ffb5-4b85-9f7b-526d368876a7 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:13.875877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 609/1206] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:13.881865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff4c9-874b-4ddf-9e5a-869ad71d30c7 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:13.882310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff4c9-874b-4ddf-9e5a-869ad71d30c7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:13.882456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff4c9-874b-4ddf-9e5a-869ad71d30c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:13.902101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-067ff4c9-874b-4ddf-9e5a-869ad71d30c7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:13.903365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-067ff4c9-874b-4ddf-9e5a-869ad71d30c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:13.974467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 598/1207] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:14.241038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae681-ffb5-4b85-9f7b-526d368876a7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:14.366315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae681-ffb5-4b85-9f7b-526d368876a7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:14.408537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:14.409278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:14.412281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:14.412281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:14.423024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:20:14.428466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:14.429453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:14.430538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 610/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:20:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:14.436528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff4c9-874b-4ddf-9e5a-869ad71d30c7 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:14.486584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:14.571579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff4c9-874b-4ddf-9e5a-869ad71d30c7 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:14.616908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:14.617865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:14.618164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:14.618457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:14.619226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:14.619573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:14.621115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:14.631142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 599/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:20:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:14.636764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:14.695148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:14.754766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da270ca8-8814-483f-9c1f-d6333f9d8722 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:14.793716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:14.794249 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:14.794525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:14.794793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:14.806101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:14.807550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:14.830831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:14.832042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:14.833377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:14.833377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:14.833377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:14.836540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 611/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:14.838287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:14.955722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:14.959474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2051a5-a0b5-495a-bef5-50690a63dd22 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:14.999560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:15.000174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:15.000535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:15.000771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:15.001554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:15.001905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:15.003516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:15.019597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 600/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:20:15.025810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:15.147941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d237a5-dfa8-43de-972e-255b86e3643c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:15.149534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:15.187663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:15.188702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:15.189286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:15.189723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] PATH_INFO: `/v3/users/placement` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:15.199210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:15.200827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:20:15.216155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:15.217469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:15.218630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 612/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:20:15.224149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:15.351972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148da92-d716-4910-89db-ca9f1dc17c67 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:15.390106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:15.390927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:15.391204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:15.391663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:15.392695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:15.393021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:15.395073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:15.423834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:15.424218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 601/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Sep 1 00:20:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:15.564894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4e333-24e7-422c-aceb-d22e7a92b61a None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:15.612460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:15.613076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:15.613354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:15.613626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:15.646547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:15.693037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:15.694606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:15.821209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 613/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:20:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 00:20:15.828682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:15.850719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:15.954071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a8d8-5fd8-412d-b3c6-3d324fb3d932 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:15.992495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:15.993212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:15.993386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:15.993658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:16.005466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:16.007029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:16.022321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:16.024487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:16.030133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:16.030133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:16.030133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:16.030133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 602/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:16.030873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:16.110464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:16.161179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd17c73-cb99-4b3f-aaa6-30dd1f83114c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:16.198212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:16.198907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:16.199211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:16.199468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:16.200425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:16.200562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:16.202111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:16.219562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 614/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:20:16.221154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:16.304094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:16.342062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456a73e-023c-40ea-9569-7ef98d8110c2 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:16.385718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:16.386427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:16.386808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:16.387088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:16.395153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:16.400197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:20:16.412672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:16.414041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:16.415430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 603/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:20:16.421939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:16.547137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eefbb-fb9c-4aa8-83c5-dd71f8118226 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:16.577991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:16.593154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765cc8a-1a65-4996-aabe-bf9e8bb7f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:16.593956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cc8a-1a65-4996-aabe-bf9e8bb7f467 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:16.594463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cc8a-1a65-4996-aabe-bf9e8bb7f467 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:16.594782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cc8a-1a65-4996-aabe-bf9e8bb7f467 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:16.595737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765cc8a-1a65-4996-aabe-bf9e8bb7f467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:16.596061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765cc8a-1a65-4996-aabe-bf9e8bb7f467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:16.597555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765cc8a-1a65-4996-aabe-bf9e8bb7f467 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:16.616538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 615/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:16.619480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:16.737489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753db97b-fb78-4d4c-81a3-59b455fbb0b4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:16.774258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:16.782710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f066ee-92ab-49fa-89f2-7496c4508004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:16.783252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f066ee-92ab-49fa-89f2-7496c4508004 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:16.783532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f066ee-92ab-49fa-89f2-7496c4508004 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:16.783804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f066ee-92ab-49fa-89f2-7496c4508004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:16.784555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f066ee-92ab-49fa-89f2-7496c4508004 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=db5c6d78083342ab923e2258b763dc36) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:16.786066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f066ee-92ab-49fa-89f2-7496c4508004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:16.786299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f066ee-92ab-49fa-89f2-7496c4508004 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:16.792532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 604/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:20:16 2022] GET /identity/v3/role_assignments?user.id=db5c6d78083342ab923e2258b763dc36&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:18.697549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52fd2a-50e0-4f71-b83d-d0e13e38f70b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:18.698159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52fd2a-50e0-4f71-b83d-d0e13e38f70b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:18.698159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52fd2a-50e0-4f71-b83d-d0e13e38f70b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:18.699421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 616/1220] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:18.705024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b00c9-64f7-4508-b241-52b4b1efc447 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:18.705435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b00c9-64f7-4508-b241-52b4b1efc447 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:18.705571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b00c9-64f7-4508-b241-52b4b1efc447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:18.724824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-fb7b00c9-64f7-4508-b241-52b4b1efc447 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:18.726265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fb7b00c9-64f7-4508-b241-52b4b1efc447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:18.797363 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 605/1221] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:19.063627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52fd2a-50e0-4f71-b83d-d0e13e38f70b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:19.188780 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52fd2a-50e0-4f71-b83d-d0e13e38f70b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:19.227399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:19.227940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:19.228213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:19.228506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:19.239584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:20:19.244555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:19.245735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:20:19.246804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:19.251468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 617/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:20:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:19.252602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b00c9-64f7-4508-b241-52b4b1efc447 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:19.361140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b00c9-64f7-4508-b241-52b4b1efc447 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:19.388539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:19.400629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:19.401306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:19.401726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:19.402003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:19.402751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:19.403136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:19.404740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:19.414240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 606/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:20:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:19.420996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:19.478816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:19.553092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6759d-e827-46ca-8303-683716658f80 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:19.589564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:19.590188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:19.590463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:19.590724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:19.602309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:19.603737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:19.620648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:19.622073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:19.623947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:19.623947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:19.623947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:19.623947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 618/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:19.628311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:19.732345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531cc3-05eb-4816-a41f-fba18d374bb7 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:19.769799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:19.770566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:19.770917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:19.771300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:19.772066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:19.772461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:19.774912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:19.792055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 607/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:20:19.798179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:19.898900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:19.906561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a930-9f41-46cd-8e41-810d78a4af7b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:19.940934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:19.941575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:19.941883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:19.942098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:19.949839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:19.951779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:20:19.963009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:19.964485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:19.965539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 619/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:19.971165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:20.022565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:20.077020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def1e5-90c7-4ff6-9d87-6662518313b4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:20.115337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:20.116014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:20.116285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:20.116604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:20.117323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:20.117622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:20.119144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:20.137607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 608/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Sep 1 00:20:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:20.143993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:20.251284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf2cb-e245-4167-8db5-a47e5cf8ea70 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:20.286444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:20.287285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:20.287689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:20.287969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:20.301108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:20.302753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:20.325645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:20.326783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:20.327928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:20.327928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:20.327928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:20.327928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 620/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:20.333335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:20.443381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dfb67-3fe6-4da7-9dfa-abe6e28d0449 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:20.446004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:20.482023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:20.483368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:20.483669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:20.483973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:20.484698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:20.484999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:20.486575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:20.503608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 609/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:20.504825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:20.517949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:20.624442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3625fa-9dcf-4f99-ba7f-447beb4f9fd2 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:20.660302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:20.660968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:20.661326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:20.661672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:20.668779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:20.670260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:20:20.681701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:20.682824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:20.684202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 621/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:20:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:20.689153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:20.794807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145655ac-069a-4c3b-bbce-346bcc37d08e None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:20.833517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e482b-7280-4050-bd07-3bfd301a5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:20.834156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e482b-7280-4050-bd07-3bfd301a5344 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:20.834463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e482b-7280-4050-bd07-3bfd301a5344 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:20.834772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e482b-7280-4050-bd07-3bfd301a5344 None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:20.835504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e482b-7280-4050-bd07-3bfd301a5344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:20.835810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e482b-7280-4050-bd07-3bfd301a5344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:20.837420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e482b-7280-4050-bd07-3bfd301a5344 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:20.856644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 610/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:20.858422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:20.939128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:20.978487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa11d3d-eb4e-482f-b386-49cbb57971c4 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:21.019260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55ec6-3cd0-4038-a4cc-dd972c9de825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:21.019930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55ec6-3cd0-4038-a4cc-dd972c9de825 None admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:21.020234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55ec6-3cd0-4038-a4cc-dd972c9de825 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:21.020516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55ec6-3cd0-4038-a4cc-dd972c9de825 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/db5c6d78083342ab923e2258b763dc36/roles/80e9dd6f85584a769f314f6f052c4cc2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:21.036518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55ec6-3cd0-4038-a4cc-dd972c9de825 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=db5c6d78083342ab923e2258b763dc36, role_id=80e9dd6f85584a769f314f6f052c4cc2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:21.038268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55ec6-3cd0-4038-a4cc-dd972c9de825 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:21.051811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 622/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:20:20 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/db5c6d78083342ab923e2258b763dc36/roles/80e9dd6f85584a769f314f6f052c4cc2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:20:22.926155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d3f5-210e-4736-9790-759f66e55733 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:22.926670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d3f5-210e-4736-9790-759f66e55733 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:22.926670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d3f5-210e-4736-9790-759f66e55733 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:22.927846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 611/1233] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:20:22.933031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89cc8-66d7-4b5d-b648-a3cf3e832163 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:22.933773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89cc8-66d7-4b5d-b648-a3cf3e832163 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:22.933773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89cc8-66d7-4b5d-b648-a3cf3e832163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:22.953343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-aea89cc8-66d7-4b5d-b648-a3cf3e832163 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:22.954538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-aea89cc8-66d7-4b5d-b648-a3cf3e832163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:23.030080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 623/1234] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:20:23.344179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d3f5-210e-4736-9790-759f66e55733 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:23.371685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:23.454937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d3f5-210e-4736-9790-759f66e55733 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:23.488597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:23.489218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:23.489493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:23.489763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:23.500117 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:20:23.504847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:23.505881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:23.506742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 612/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Sep 1 00:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:23.512465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89cc8-66d7-4b5d-b648-a3cf3e832163 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:23.563077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:23.619445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89cc8-66d7-4b5d-b648-a3cf3e832163 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:23.656107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:23.656840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:23.657127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:23.657459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:23.658384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] RBAC: Adding query filter params (name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:23.658812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:23.660824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:23.670527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 624/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Sep 1 00:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:23.676654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:23.777932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:23.798924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5410685-c7b3-4ad1-85fc-6216d70302bd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:23.837284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:23.838048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:23.838360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:23.838796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:23.849426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:23.851125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:23.867219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:23.868483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:23.869444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:23.869444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:23.869444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:23.869444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 613/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:23.876777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:23.977973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301fa1-f1c8-409d-b615-0a466ffd1f75 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:23.987045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:24.013213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:24.014339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:24.014620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:24.014885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:24.015522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:24.015811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:24.017203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:24.030831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 625/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:20:24.036881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:24.157686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5cd6b-482e-4be1-afec-6e11734dfaed None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:24.195731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:24.196585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:24.196937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:24.197211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] PATH_INFO: `/v3/users/placement` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:24.200054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:24.206610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:24.208316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:20:24.220676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:24.221797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:24.223147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 614/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:24.228115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:24.344476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd82e70-ea4b-4f20-9815-1dfb103ee1d5 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:24.386298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:24.387009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:24.387296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:24.387592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:24.388475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:24.389391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:24.390817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:24.414309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 626/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Sep 1 00:20:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:24.420642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:24.538462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd901183-712c-4ce8-9317-a3c2891825df None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:24.581985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:24.582811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:24.583129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:24.583557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:24.655722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:24.663658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:24.665536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:24.776280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 615/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:20:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 00:20:24.783334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:24.812877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:24.899749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad7879-1535-455d-92e8-ad30923ddfab None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:24.935912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:24.936600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:24.936878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:24.937148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:24.947349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:24.948845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:24.964065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:24.965294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:24.966583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:24.966583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:24.966583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:24.966583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 627/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:24.971253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:25.075901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:25.083281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d45a-fef4-4faa-be39-666c28a5055d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:25.124077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:25.124883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:25.125230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:25.125553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:25.126567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:25.126998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:25.129059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:25.143248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 616/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:25.149366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:25.243710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:25.267994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb386-6fc4-4671-b5f1-ff08f9ecac11 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:25.304684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:25.305311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:25.305643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:25.305941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:25.313571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:25.315259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:20:25.327326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:25.328363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:25.329344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 628/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:25.334862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:25.445959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986752-f985-4882-bdb0-8bbed092a3ef None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:25.486229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9050-9635-49d1-9dbc-edd78cc537ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:25.486842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9050-9635-49d1-9dbc-edd78cc537ef None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:25.487206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9050-9635-49d1-9dbc-edd78cc537ef None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:25.487628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9050-9635-49d1-9dbc-edd78cc537ef None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:25.488495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9050-9635-49d1-9dbc-edd78cc537ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:25.488903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9050-9635-49d1-9dbc-edd78cc537ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:25.490762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9050-9635-49d1-9dbc-edd78cc537ef None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:25.504373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 617/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:20:25.512598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:25.634443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913bc8e-0e7d-4905-a933-486aeb9c4f19 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:25.681839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e95c36-c807-453f-8a8b-1ec75b605922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:25.682771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e95c36-c807-453f-8a8b-1ec75b605922 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:25.683303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e95c36-c807-453f-8a8b-1ec75b605922 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:25.683768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e95c36-c807-453f-8a8b-1ec75b605922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:25.684901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e95c36-c807-453f-8a8b-1ec75b605922 None admin] RBAC: Adding query filter params (role.id=80e9dd6f85584a769f314f6f052c4cc2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=db5c6d78083342ab923e2258b763dc36) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:25.685223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e95c36-c807-453f-8a8b-1ec75b605922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:25.687454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e95c36-c807-453f-8a8b-1ec75b605922 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:25.711188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 629/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:20:25 2022] GET /identity/v3/role_assignments?user.id=db5c6d78083342ab923e2258b763dc36&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=80e9dd6f85584a769f314f6f052c4cc2 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:27.963829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126f955-74e4-4c6e-8344-adb776a1cc81 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:27.964449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126f955-74e4-4c6e-8344-adb776a1cc81 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:27.964449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126f955-74e4-4c6e-8344-adb776a1cc81 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:27.965717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 618/1247] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:27.971901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234008f-05c3-4ba0-9f3b-ad5d8057a382 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:27.972358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234008f-05c3-4ba0-9f3b-ad5d8057a382 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:27.972465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234008f-05c3-4ba0-9f3b-ad5d8057a382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:27.979032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:27.995239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5234008f-05c3-4ba0-9f3b-ad5d8057a382 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:27.996745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5234008f-05c3-4ba0-9f3b-ad5d8057a382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:28.078091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 630/1248] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:28.362243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126f955-74e4-4c6e-8344-adb776a1cc81 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:28.381556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:28.479229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126f955-74e4-4c6e-8344-adb776a1cc81 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:28.514045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:28.514702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:28.515084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:28.515361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:28.527859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:20:28.533368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:28.534520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:28.535399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 619/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:28.542345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234008f-05c3-4ba0-9f3b-ad5d8057a382 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:28.666034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234008f-05c3-4ba0-9f3b-ad5d8057a382 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:28.698341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:28.708829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:28.709582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:28.709924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:28.710260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:28.711032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:28.711397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:28.712981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:28.722478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 631/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:28.728463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:28.814328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:28.840414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a9281-74bf-4967-b2f3-7476ab458294 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:28.887011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:28.887641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:28.887919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:28.888189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:28.898306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:28.899762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:28.915308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:28.916553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:28.917554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:28.917554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:28.917554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:28.917554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 620/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:28.922974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:29.032147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50412d5-de51-492e-b86b-ae3bea6eaf52 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:29.069379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:29.069983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:29.070258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:29.070521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:29.071151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:29.071447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:29.072884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:29.085259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 632/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:29.091443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:29.211889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cebe3e-f5db-48c2-95ce-bff1367c0e5b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:29.240292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:29.249622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:29.250248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:29.250524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:29.250792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] PATH_INFO: `/v3/users/placement` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:29.258582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:29.260506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:20:29.272708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:29.274331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:29.275607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 621/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:29.280023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:29.336343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:29.383540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c72a76-6741-4be5-979f-d776eb25aa48 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:29.417552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:29.418154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:29.418433 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:29.418701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:29.419416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:29.419743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:29.421229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:29.440898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 633/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Sep 1 00:20:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:29.446720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:29.556511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42eb18-5f6a-449f-92d8-822406b5dccb None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:29.593397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:29.593998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:29.594319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:29.594566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:29.652626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:29.666677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:29.668452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:29.777379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 622/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:20:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:20:29.783417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:29.894792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08e7c-ad94-4121-8e92-ee599433526b None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:29.909917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:29.932964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:29.933622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:29.933903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:29.934175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:29.946202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:29.947696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:29.963895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:29.965009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:29.965940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:29.965940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:29.965940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:29.965940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 634/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:29.971244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:30.064004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:30.076491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf15ec-0b5e-440a-9399-e555f400f426 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:30.114948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:30.116350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:30.116585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:30.116940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:30.117620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:30.118022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:30.119563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:30.133097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 623/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:20:30.138753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:30.246495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f12f-4561-486d-af6a-aa6bb20c3702 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:30.281466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:30.282101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:30.282375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:30.282644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:30.289935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:30.291395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:20:30.303331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:30.304223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:30.305341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:30.308502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 635/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:20:30.310644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:30.412496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400cb1e-9916-4973-8ad0-8dbbd5207ca8 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:30.446735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9a11-089b-4004-b3d1-321ecd58da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:30.447344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9a11-089b-4004-b3d1-321ecd58da6b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:30.447623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9a11-089b-4004-b3d1-321ecd58da6b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:30.447894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9a11-089b-4004-b3d1-321ecd58da6b None admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:30.448630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f9a11-089b-4004-b3d1-321ecd58da6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:30.448931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f9a11-089b-4004-b3d1-321ecd58da6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:30.450363 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f9a11-089b-4004-b3d1-321ecd58da6b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:30.463630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 624/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:30.470135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:30.497939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:30.577222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51aa62-4b80-4443-b128-d0e757ec1308 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:30.609983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a64d4-5e6e-410a-a48e-5f7a1d6d1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:30.610578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a64d4-5e6e-410a-a48e-5f7a1d6d1f2d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:30.610859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a64d4-5e6e-410a-a48e-5f7a1d6d1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:30.611132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a64d4-5e6e-410a-a48e-5f7a1d6d1f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:30.611851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a64d4-5e6e-410a-a48e-5f7a1d6d1f2d None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=db5c6d78083342ab923e2258b763dc36) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:30.612157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a64d4-5e6e-410a-a48e-5f7a1d6d1f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:30.613626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a64d4-5e6e-410a-a48e-5f7a1d6d1f2d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:30.618807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 636/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:20:30 2022] GET /identity/v3/role_assignments?user.id=db5c6d78083342ab923e2258b763dc36&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:32.480021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dea7c-4508-4e54-8287-7095b5e53155 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:32.480643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dea7c-4508-4e54-8287-7095b5e53155 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:32.480643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dea7c-4508-4e54-8287-7095b5e53155 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:32.482106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 625/1261] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:32.487265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187bc1-70fd-42f8-aa86-3034ae750249 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:32.487665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187bc1-70fd-42f8-aa86-3034ae750249 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:32.487806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187bc1-70fd-42f8-aa86-3034ae750249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:32.505828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fa187bc1-70fd-42f8-aa86-3034ae750249 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:32.507005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fa187bc1-70fd-42f8-aa86-3034ae750249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:32.575214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 637/1262] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:32.839489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dea7c-4508-4e54-8287-7095b5e53155 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:32.851001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:32.937453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dea7c-4508-4e54-8287-7095b5e53155 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:32.969949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:32.970553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:32.970824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:32.971089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:32.980836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:20:32.985572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:32.986665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:32.989531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 626/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:20:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:32.992688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa187bc1-70fd-42f8-aa86-3034ae750249 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:33.010158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:33.087901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa187bc1-70fd-42f8-aa86-3034ae750249 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:33.126173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:33.126701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:33.126976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:33.127240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:33.127928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:33.128230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:33.129963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:33.146535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 638/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:20:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:33.147886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:33.218341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:33.250929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f847ef-3835-4e86-b930-e0119855036d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:33.283583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:33.284198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:33.284497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:33.284764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:33.294389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:33.296370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:33.310324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:33.311444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:33.312841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:33.312841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:33.312841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:33.312841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 627/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 00:20:33.317155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:33.394772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:33.413727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152072-c1b6-408a-a8cc-a3b2f397ef5f None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:33.445417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:33.446000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:33.446272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:33.446538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:33.447160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:33.447454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:33.448838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:33.460478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 639/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:33.465950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:33.564405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f57e7-73a8-486f-a000-762a48134ef5 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:33.583277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:33.596668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:33.597277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:33.597549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:33.597817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] PATH_INFO: `/v3/users/placement` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:33.605073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:33.606495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:20:33.617631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:33.618767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:33.619787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 628/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:33.624622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:33.719999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67128ac3-41f2-4c9e-910a-47a25ea7c195 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:33.752008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:33.752616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:33.752896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:33.753167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:33.753877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:33.754182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:33.755594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:33.764404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:33.772859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 640/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Sep 1 00:20:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:33.778328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:33.874364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bce5c-d432-4ce1-95f5-4904397ae25d None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:33.906469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:33.907072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:33.907348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:33.907614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:33.917612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:33.919042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:33.932542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:33.933658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:33.934612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:33.934612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:33.934612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:33.934612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 629/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:33.939714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:34.035081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e25df-b38c-4343-b7bb-de54e16f6f7c None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:34.068041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:34.068733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:34.069011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:34.069283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:34.069910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:34.070210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:34.071579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:34.082773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 641/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:34.088243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:34.128414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:34.195446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2caad0-1fb2-46e3-b3c5-6871dc7bb3e3 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:34.227961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:34.228600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:34.228876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:34.229144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:34.236051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:34.237516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:20:34.248915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:34.249968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:34.251002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 630/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:34.255835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:34.312804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:34.353236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e885c-a0c4-4014-b1ce-34346739ace8 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:34.385598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1c52b-321c-4f0e-b52a-cb5e4f6628f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:34.386180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c52b-321c-4f0e-b52a-cb5e4f6628f7 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:34.386453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c52b-321c-4f0e-b52a-cb5e4f6628f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:34.386720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c52b-321c-4f0e-b52a-cb5e4f6628f7 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:34.387385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1c52b-321c-4f0e-b52a-cb5e4f6628f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:34.387682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1c52b-321c-4f0e-b52a-cb5e4f6628f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:34.389170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1c52b-321c-4f0e-b52a-cb5e4f6628f7 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:34.400507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 642/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:34.406256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:34.495037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:34.504184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028cc4-968e-4864-ba43-7db7c06e530a None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:34.536062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437986ef-5b1f-437c-946d-03eb2dcfb689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:34.536742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437986ef-5b1f-437c-946d-03eb2dcfb689 None admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:34.537012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437986ef-5b1f-437c-946d-03eb2dcfb689 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:34.537273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437986ef-5b1f-437c-946d-03eb2dcfb689 None admin] PATH_INFO: `/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/db5c6d78083342ab923e2258b763dc36/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:34.539101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437986ef-5b1f-437c-946d-03eb2dcfb689 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cd74f2fffc49a99b6f11230064325a, user_id=db5c6d78083342ab923e2258b763dc36, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:34.540548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437986ef-5b1f-437c-946d-03eb2dcfb689 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:34.553167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 631/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Sep 1 00:20:34 2022] PUT /identity/v3/projects/40cd74f2fffc49a99b6f11230064325a/users/db5c6d78083342ab923e2258b763dc36/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:20:36.417475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454bfd-ebfe-4f1f-bb5d-a8fdea239b06 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:36.417999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454bfd-ebfe-4f1f-bb5d-a8fdea239b06 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:36.417999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454bfd-ebfe-4f1f-bb5d-a8fdea239b06 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:36.419936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 643/1274] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:36.425027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb421-6094-4090-aa21-fc7e1725723d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:36.425396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb421-6094-4090-aa21-fc7e1725723d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:36.425564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb421-6094-4090-aa21-fc7e1725723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:36.443225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-659eb421-6094-4090-aa21-fc7e1725723d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:36.444418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-659eb421-6094-4090-aa21-fc7e1725723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:36.511371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 632/1275] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:36.779047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454bfd-ebfe-4f1f-bb5d-a8fdea239b06 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:36.878335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454bfd-ebfe-4f1f-bb5d-a8fdea239b06 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:36.894804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:36.911848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:36.912490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:36.912771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:36.913043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:36.923485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 00:20:36.928270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:36.929396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:36.930283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 644/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Sep 1 00:20:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:36.935196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb421-6094-4090-aa21-fc7e1725723d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:37.012535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:37.031293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb421-6094-4090-aa21-fc7e1725723d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:37.063824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:37.064434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:37.064711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:37.064977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:37.065628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:37.065927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:37.067287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:37.075172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 633/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Sep 1 00:20:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:37.080874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:37.189290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5cae-e2cb-43af-9aaf-5710ced7b8e6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:37.222242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:37.222856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:37.223133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:37.223401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:37.233155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:37.234594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:37.248500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:37.249609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:37.250733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:37.250733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:37.250733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:37.250733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 645/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:37.257089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:37.360249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef2d17-f82f-4b94-8f04-0abc761d7b63 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:37.392520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:37.393113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:37.393389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:37.393660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:37.394288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:37.394588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:37.395957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:37.408241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 634/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:37.413962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:37.443522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:37.511282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d57a0-2c71-4806-84b9-a5b49f950558 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:37.544823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:37.545443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:37.545730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:37.545988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] PATH_INFO: `/v3/users/placement` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:37.553906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:37.555360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 00:20:37.566608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:37.567741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:37.568982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 646/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:37.576185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:37.579963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:37.671833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e0eb3-f451-400b-8fe0-135f258ffe99 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:37.705096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:37.705783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:37.706058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:37.706321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:37.707025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:37.707323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:37.708752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:37.725041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 635/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Sep 1 00:20:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:37.731074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:37.818259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:37.828552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62927eb5-c9ba-4c33-8206-bfc70cb96bde None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:37.860809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:37.861393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:37.861668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:37.861937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:37.926491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:37.927866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:38.012106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:38.022150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 647/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Sep 1 00:20:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 00:20:38.027805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:38.086785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:38.123711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c98c73-f4c3-49f6-a99a-644aaee553c4 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:38.156792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:38.157405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:38.157679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:38.157946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:38.167529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:38.169052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 00:20:38.183204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:38.184211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 00:20:38.185469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 00:20:38.185469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 00:20:38.185469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:38.185469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 636/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:38.189825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:38.284736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df16666-0ea6-463b-a8ee-8102b6f2f8d9 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:38.316981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:38.317567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:38.317845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:38.318117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:38.318740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:38.319040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:38.320425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:38.331836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 648/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Sep 1 00:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:38.337303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:38.434504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53219-34a2-4d67-96e5-bcd81a91dc1b None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:38.447870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:38.468191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:38.468824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:38.469102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:38.469372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:38.475978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:38.477443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 00:20:38.488343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:38.489253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: ERROR keystone.server.flask.application Sep 01 00:20:38.490244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 637/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Sep 1 00:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:38.495133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:38.547905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:38.595873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1467-1e9f-43a1-bf1e-6d1a973fdab6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:38.628048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628497-f69c-410f-af82-8b8ef9fbeb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:38.628665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628497-f69c-410f-af82-8b8ef9fbeb40 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:38.628941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628497-f69c-410f-af82-8b8ef9fbeb40 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:38.629207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628497-f69c-410f-af82-8b8ef9fbeb40 None admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:38.629881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628497-f69c-410f-af82-8b8ef9fbeb40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:38.630177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628497-f69c-410f-af82-8b8ef9fbeb40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:38.631593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628497-f69c-410f-af82-8b8ef9fbeb40 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:38.646351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 649/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Sep 1 00:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:38.652529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:38.748818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa213c-29ca-470a-80ee-fde98ab3a167 None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:38.780124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42b53f-05d9-4a37-99de-d8cefccb333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:38.780733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b53f-05d9-4a37-99de-d8cefccb333d None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:38.781008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b53f-05d9-4a37-99de-d8cefccb333d None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:38.781278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b53f-05d9-4a37-99de-d8cefccb333d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:38.781986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42b53f-05d9-4a37-99de-d8cefccb333d None admin] RBAC: Adding query filter params (role.id=a0559ae5fc294f8a936407225ebf74d2, scope.project.id=40cd74f2fffc49a99b6f11230064325a, user.id=db5c6d78083342ab923e2258b763dc36) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:38.782290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42b53f-05d9-4a37-99de-d8cefccb333d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:38.783734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42b53f-05d9-4a37-99de-d8cefccb333d None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:38.789322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 638/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Sep 1 00:20:38 2022] GET /identity/v3/role_assignments?user.id=db5c6d78083342ab923e2258b763dc36&scope.project.id=40cd74f2fffc49a99b6f11230064325a&role.id=a0559ae5fc294f8a936407225ebf74d2 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:40.671775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f578c-3311-47b5-9376-a4ab13f32f4c None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:40.672353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f578c-3311-47b5-9376-a4ab13f32f4c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:40.672353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f578c-3311-47b5-9376-a4ab13f32f4c None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:40.673674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 650/1288] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:40.678746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732495b-56e4-4292-9847-d15293f25fdd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:40.679177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732495b-56e4-4292-9847-d15293f25fdd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:40.679281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732495b-56e4-4292-9847-d15293f25fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:40.697557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6732495b-56e4-4292-9847-d15293f25fdd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:40.698731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6732495b-56e4-4292-9847-d15293f25fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:40.727797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:40.764733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 639/1289] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:41.027094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f578c-3311-47b5-9376-a4ab13f32f4c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:41.138057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f578c-3311-47b5-9376-a4ab13f32f4c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:41.151270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:41.177141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:41.177761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:41.178037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:41.178304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] PATH_INFO: `/v3/services/placement` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:41.178873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:41.180254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:41.188831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:41.190109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:41.191411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 651/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:20:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:41.195882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732495b-56e4-4292-9847-d15293f25fdd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:41.303257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732495b-56e4-4292-9847-d15293f25fdd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:41.336637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e897d7f-0913-4664-925d-0e348f2a3f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:41.337226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897d7f-0913-4664-925d-0e348f2a3f4a None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:41.337499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897d7f-0913-4664-925d-0e348f2a3f4a None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:41.337766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897d7f-0913-4664-925d-0e348f2a3f4a None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:41.338380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e897d7f-0913-4664-925d-0e348f2a3f4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:41.338682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e897d7f-0913-4664-925d-0e348f2a3f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:41.340045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e897d7f-0913-4664-925d-0e348f2a3f4a None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:41.344715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 640/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Sep 1 00:20:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:41.350676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:41.447561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0c46-8c58-4605-8d5f-678b049d524d None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:41.479853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6b67e-7d74-4254-a6a4-1b51ce34b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:41.480464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b67e-7d74-4254-a6a4-1b51ce34b161 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:41.480744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b67e-7d74-4254-a6a4-1b51ce34b161 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:41.481015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b67e-7d74-4254-a6a4-1b51ce34b161 None admin] PATH_INFO: `/v3/services` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:41.481635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6b67e-7d74-4254-a6a4-1b51ce34b161 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:41.481932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6b67e-7d74-4254-a6a4-1b51ce34b161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:41.483297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6b67e-7d74-4254-a6a4-1b51ce34b161 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:41.487578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 652/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Sep 1 00:20:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:43.354950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042c18-284b-422f-9412-9e1b3137a72c None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:43.355503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042c18-284b-422f-9412-9e1b3137a72c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:43.355503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042c18-284b-422f-9412-9e1b3137a72c None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:43.357340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 641/1293] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:43.362500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6853-c1a1-439e-a42f-f7b6d822dc06 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:43.362904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6853-c1a1-439e-a42f-f7b6d822dc06 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:43.363181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6853-c1a1-439e-a42f-f7b6d822dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:43.381770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-623e6853-c1a1-439e-a42f-f7b6d822dc06 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:43.382945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-623e6853-c1a1-439e-a42f-f7b6d822dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:43.411010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:43.447863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 653/1294] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:43.714359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042c18-284b-422f-9412-9e1b3137a72c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:43.745626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:43.813599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042c18-284b-422f-9412-9e1b3137a72c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:43.845647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3679f14-d67b-4685-9c46-619e4b5d0e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:43.846227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3679f14-d67b-4685-9c46-619e4b5d0e08 None admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:43.846499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3679f14-d67b-4685-9c46-619e4b5d0e08 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:43.846765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3679f14-d67b-4685-9c46-619e4b5d0e08 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:43.847390 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3679f14-d67b-4685-9c46-619e4b5d0e08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:43.848765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3679f14-d67b-4685-9c46-619e4b5d0e08 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:43.863271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 642/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Sep 1 00:20:43 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:20:45.769341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac777-d41c-4414-894d-34e074295b96 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:45.769896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac777-d41c-4414-894d-34e074295b96 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:45.769896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac777-d41c-4414-894d-34e074295b96 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:45.771213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 654/1296] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:45.776345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6fe6-00d4-4db3-aa21-a30e5fb342ed None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:45.776756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6fe6-00d4-4db3-aa21-a30e5fb342ed None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:45.776854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6fe6-00d4-4db3-aa21-a30e5fb342ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:45.795014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-646e6fe6-00d4-4db3-aa21-a30e5fb342ed None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:45.796171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-646e6fe6-00d4-4db3-aa21-a30e5fb342ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:45.865470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 643/1297] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 00:20:46.127095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fac777-d41c-4414-894d-34e074295b96 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:46.224574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fac777-d41c-4414-894d-34e074295b96 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:46.257753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:46.258360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:46.258637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:46.258903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:46.259469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:46.260861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:46.269278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:46.270444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:46.271474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 655/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:20:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:46.276175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6fe6-00d4-4db3-aa21-a30e5fb342ed None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:46.294334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:46.372938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6fe6-00d4-4db3-aa21-a30e5fb342ed None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:46.404977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:46.405507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:46.405781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:46.406048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:46.406664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:46.406961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:46.408323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:46.413265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 644/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Sep 1 00:20:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:46.419611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:46.450382 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:46.516260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aad3e-a920-4822-b7f6-f6e4a296fd12 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:46.548802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ab51-555a-4c80-ba82-8046ead159e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:46.549404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ab51-555a-4c80-ba82-8046ead159e4 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:46.549685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ab51-555a-4c80-ba82-8046ead159e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:46.549958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ab51-555a-4c80-ba82-8046ead159e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:46.550649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74ab51-555a-4c80-ba82-8046ead159e4 None admin] RBAC: Adding query filter params (interface=public, service_id=fe8bfaf0453c4c09afb431407d4dd8d4, region_id=RegionOne) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:46.550956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74ab51-555a-4c80-ba82-8046ead159e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:46.553386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74ab51-555a-4c80-ba82-8046ead159e4 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:46.562590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 656/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Sep 1 00:20:46 2022] GET /identity/v3/endpoints?service_id=fe8bfaf0453c4c09afb431407d4dd8d4&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:46.568216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:46.647250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:46.665719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164751b-06c9-431f-b547-7a3bcb0cb3cd None admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:46.698030 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193c53a-b654-4ac1-a5ab-007cb369a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:46.698621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193c53a-b654-4ac1-a5ab-007cb369a392 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:46.698897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193c53a-b654-4ac1-a5ab-007cb369a392 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:46.699170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193c53a-b654-4ac1-a5ab-007cb369a392 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:46.699765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193c53a-b654-4ac1-a5ab-007cb369a392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:46.701187 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193c53a-b654-4ac1-a5ab-007cb369a392 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:46.707678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 645/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Sep 1 00:20:46 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:20:48.582838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee0d9-4fa4-4961-a395-7619e99a78c7 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:48.583342 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee0d9-4fa4-4961-a395-7619e99a78c7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:48.583785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee0d9-4fa4-4961-a395-7619e99a78c7 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:48.585340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 657/1302] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:20:48.593229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a8e9-abe7-4bf4-97f3-bde6c267f062 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:48.593669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a8e9-abe7-4bf4-97f3-bde6c267f062 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:48.593776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5a8e9-abe7-4bf4-97f3-bde6c267f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:48.611641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7cc5a8e9-abe7-4bf4-97f3-bde6c267f062 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:20:48.612858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7cc5a8e9-abe7-4bf4-97f3-bde6c267f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:20:48.677208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 646/1303] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:20:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 00:20:48.943280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee0d9-4fa4-4961-a395-7619e99a78c7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:49.035182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:49.041943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee0d9-4fa4-4961-a395-7619e99a78c7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:49.073871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:49.074480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:49.074838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:49.075111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:49.075682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:49.077085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 00:20:49.085531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 00:20:49.086686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application with Lock( Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self._enter() Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application return self.creator() Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application created_value = creator( Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: ERROR keystone.server.flask.application Sep 01 00:20:49.087571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 658/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Sep 1 00:20:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 00:20:49.093412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5a8e9-abe7-4bf4-97f3-bde6c267f062 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:49.183457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:49.205910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5a8e9-abe7-4bf4-97f3-bde6c267f062 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:49.238415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3747e1-3d79-404c-baab-5da0f2b34ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:49.239009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3747e1-3d79-404c-baab-5da0f2b34ef6 None admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:49.239281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3747e1-3d79-404c-baab-5da0f2b34ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:49.239554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3747e1-3d79-404c-baab-5da0f2b34ef6 None admin] PATH_INFO: `/v3/services` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:49.240167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3747e1-3d79-404c-baab-5da0f2b34ef6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:20:49.240493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3747e1-3d79-404c-baab-5da0f2b34ef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:49.241857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3747e1-3d79-404c-baab-5da0f2b34ef6 None admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:49.246808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 647/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Sep 1 00:20:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:20:49.252598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:20:49.351100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e82449-76f0-4a5b-9253-882134908cf6 None admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:20:49.382916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8357946-0398-4391-ac10-0a87edc355ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:20:49.383498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357946-0398-4391-ac10-0a87edc355ee None admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:20:49.383775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357946-0398-4391-ac10-0a87edc355ee None admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:20:49.384044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357946-0398-4391-ac10-0a87edc355ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:20:49.384731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8357946-0398-4391-ac10-0a87edc355ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:20:49.386087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8357946-0398-4391-ac10-0a87edc355ee None admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:20:49.404743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 659/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:20:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:20:59.243803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=30 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:20:59.400732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:21:52.514596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72805c69-688c-4751-97f7-f264a62dd861 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:52.515711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72805c69-688c-4751-97f7-f264a62dd861 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:52.516217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72805c69-688c-4751-97f7-f264a62dd861 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:52.521663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 648/1307] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:21:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:21:52.523095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b202572-bd89-47f9-9100-e18b1d5e53c9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:52.523521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b202572-bd89-47f9-9100-e18b1d5e53c9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:52.523622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b202572-bd89-47f9-9100-e18b1d5e53c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:52.598901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1b202572-bd89-47f9-9100-e18b1d5e53c9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:21:52.600094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1b202572-bd89-47f9-9100-e18b1d5e53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:52.790252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 660/1308] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:21:53.083492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9377-7703-46c7-a907-b0f154ad6714 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:53.083954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9377-7703-46c7-a907-b0f154ad6714 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:53.084301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9377-7703-46c7-a907-b0f154ad6714 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:53.085880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 649/1309] 10.222.0.13 () {54 vars in 965 bytes} [Thu Sep 1 00:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:21:53.094079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25275b-c26e-463d-9946-0e26f3203afb None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:53.094488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25275b-c26e-463d-9946-0e26f3203afb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:53.094825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25275b-c26e-463d-9946-0e26f3203afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:53.173501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-dc25275b-c26e-463d-9946-0e26f3203afb None None] MFA Rules not processed for user `baa7f3487b674e75afe5fca74db44807`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:21:53.175143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-dc25275b-c26e-463d-9946-0e26f3203afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:53.197382 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:21:53.258465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 661/1310] 10.222.0.13 () {58 vars in 1062 bytes} [Thu Sep 1 00:21:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:21:53.267592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba9377-7703-46c7-a907-b0f154ad6714 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:21:53.269450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3dba9377-7703-46c7-a907-b0f154ad6714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:53.389061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba9377-7703-46c7-a907-b0f154ad6714 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:21:53.466684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21fb0-cc46-4282-aaad-3df8d9ab0912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:21:53.467603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21fb0-cc46-4282-aaad-3df8d9ab0912 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:53.468028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21fb0-cc46-4282-aaad-3df8d9ab0912 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:53.468473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21fb0-cc46-4282-aaad-3df8d9ab0912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:53.470417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-44a21fb0-cc46-4282-aaad-3df8d9ab0912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:53.541443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:21:53.606855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21fb0-cc46-4282-aaad-3df8d9ab0912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:21:53.608355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21fb0-cc46-4282-aaad-3df8d9ab0912 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:21:53.628721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 650/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:21:55.838515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d702e-cebc-467d-9c41-c6ac17e3732a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:55.839042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d702e-cebc-467d-9c41-c6ac17e3732a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:55.839042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d702e-cebc-467d-9c41-c6ac17e3732a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:55.840430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 662/1312] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:21:55.846145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4fca2-4b7e-49ba-855f-e3880dce7475 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:55.846689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4fca2-4b7e-49ba-855f-e3880dce7475 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:55.846689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4fca2-4b7e-49ba-855f-e3880dce7475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:55.937875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ffd4fca2-4b7e-49ba-855f-e3880dce7475 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:21:55.939081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ffd4fca2-4b7e-49ba-855f-e3880dce7475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:56.051642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 651/1313] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:21:56.338292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d702e-cebc-467d-9c41-c6ac17e3732a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:21:56.339887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-908d702e-cebc-467d-9c41-c6ac17e3732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:56.445995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d702e-cebc-467d-9c41-c6ac17e3732a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:21:56.516954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:21:56.519850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8d016-668d-4093-b91d-347c7c692e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:21:56.520711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d016-668d-4093-b91d-347c7c692e91 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:56.521161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d016-668d-4093-b91d-347c7c692e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:56.521608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d016-668d-4093-b91d-347c7c692e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:56.523248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-99c8d016-668d-4093-b91d-347c7c692e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:56.636861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8d016-668d-4093-b91d-347c7c692e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:21:56.638301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8d016-668d-4093-b91d-347c7c692e91 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:21:56.656624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 663/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:21:58.934263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325d83-eaf6-4fd4-8e23-7a02f7077d83 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:58.934814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325d83-eaf6-4fd4-8e23-7a02f7077d83 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:58.934814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325d83-eaf6-4fd4-8e23-7a02f7077d83 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:58.936085 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 652/1315] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:21:58.943107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329a6b-6d41-4a6b-9c9f-240668797a33 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:58.943524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329a6b-6d41-4a6b-9c9f-240668797a33 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:58.943644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329a6b-6d41-4a6b-9c9f-240668797a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:59.009058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-59329a6b-6d41-4a6b-9c9f-240668797a33 None None] MFA Rules not processed for user `cf36f62c4afc473fb33769cbc076b8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:21:59.010251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-59329a6b-6d41-4a6b-9c9f-240668797a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:59.060697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:21:59.117343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 664/1316] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:21:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:21:59.397370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325d83-eaf6-4fd4-8e23-7a02f7077d83 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:21:59.399436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b4325d83-eaf6-4fd4-8e23-7a02f7077d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:59.409066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:21:59.500731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325d83-eaf6-4fd4-8e23-7a02f7077d83 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:21:59.572576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477877a6-f1c7-48f4-84d6-528a6c1e11b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:21:59.573176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477877a6-f1c7-48f4-84d6-528a6c1e11b1 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:21:59.573451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477877a6-f1c7-48f4-84d6-528a6c1e11b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:21:59.573719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477877a6-f1c7-48f4-84d6-528a6c1e11b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:21:59.575288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-477877a6-f1c7-48f4-84d6-528a6c1e11b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:21:59.634997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:21:59.681239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477877a6-f1c7-48f4-84d6-528a6c1e11b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:21:59.682596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477877a6-f1c7-48f4-84d6-528a6c1e11b1 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:21:59.700475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 653/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:21:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:02.114028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300141-f676-4d87-8550-a1501ff8b2ae None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:02.114590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300141-f676-4d87-8550-a1501ff8b2ae None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:02.114590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300141-f676-4d87-8550-a1501ff8b2ae None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:02.115889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 665/1318] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:22:02.121152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f810e-22b4-4aab-8f9b-9d3551cceeec None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:02.121537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f810e-22b4-4aab-8f9b-9d3551cceeec None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:02.121692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f810e-22b4-4aab-8f9b-9d3551cceeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:02.185316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-aa7f810e-22b4-4aab-8f9b-9d3551cceeec None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:02.186625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-aa7f810e-22b4-4aab-8f9b-9d3551cceeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:02.282035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 654/1319] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:02.566695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a300141-f676-4d87-8550-a1501ff8b2ae None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:02.568221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5a300141-f676-4d87-8550-a1501ff8b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:02.669141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a300141-f676-4d87-8550-a1501ff8b2ae None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:02.741576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38d57-e4f7-4822-bdad-6a1ff1beb4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:02.742756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38d57-e4f7-4822-bdad-6a1ff1beb4bd service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:02.743041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38d57-e4f7-4822-bdad-6a1ff1beb4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:02.743310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38d57-e4f7-4822-bdad-6a1ff1beb4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:02.744895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-38b38d57-e4f7-4822-bdad-6a1ff1beb4bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:02.751544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:02.850257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38d57-e4f7-4822-bdad-6a1ff1beb4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:02.852157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38d57-e4f7-4822-bdad-6a1ff1beb4bd service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:02.869944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 666/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:05.403081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0048db-a7fd-4135-8646-be7de5cc6a81 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:05.403624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0048db-a7fd-4135-8646-be7de5cc6a81 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:05.403624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0048db-a7fd-4135-8646-be7de5cc6a81 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:05.405018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 655/1321] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:05.410186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d430-179f-4aff-9eef-d3942276fb16 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:05.410598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d430-179f-4aff-9eef-d3942276fb16 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:05.410872 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d430-179f-4aff-9eef-d3942276fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:05.476462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-93d6d430-179f-4aff-9eef-d3942276fb16 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:05.477665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-93d6d430-179f-4aff-9eef-d3942276fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:05.536472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:05.575852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 667/1322] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:05.870254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452aac-ac72-4e94-82eb-71bdd8dc69ee None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:05.870533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452aac-ac72-4e94-82eb-71bdd8dc69ee None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:05.870828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452aac-ac72-4e94-82eb-71bdd8dc69ee None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:05.872227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 656/1323] 10.222.0.13 () {54 vars in 965 bytes} [Thu Sep 1 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:05.877995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e1b8-fe65-4491-9e8d-515a5e3a1ed9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:05.878349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e1b8-fe65-4491-9e8d-515a5e3a1ed9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:05.878686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e1b8-fe65-4491-9e8d-515a5e3a1ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:05.954135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4ff3e1b8-fe65-4491-9e8d-515a5e3a1ed9 None None] MFA Rules not processed for user `baa7f3487b674e75afe5fca74db44807`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:05.955316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4ff3e1b8-fe65-4491-9e8d-515a5e3a1ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:06.029302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 668/1324] 10.222.0.13 () {58 vars in 1062 bytes} [Thu Sep 1 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:06.038146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6452aac-ac72-4e94-82eb-71bdd8dc69ee None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:06.039802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f6452aac-ac72-4e94-82eb-71bdd8dc69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:06.059562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:06.144784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6452aac-ac72-4e94-82eb-71bdd8dc69ee None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:06.217177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870d12c-dd77-4346-ad87-7d0a1a2ab75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:06.217777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d12c-dd77-4346-ad87-7d0a1a2ab75a service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:06.218051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d12c-dd77-4346-ad87-7d0a1a2ab75a service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:06.218317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d12c-dd77-4346-ad87-7d0a1a2ab75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:06.219910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e870d12c-dd77-4346-ad87-7d0a1a2ab75a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:06.290439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:06.327130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870d12c-dd77-4346-ad87-7d0a1a2ab75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:06.328597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870d12c-dd77-4346-ad87-7d0a1a2ab75a service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:06.346614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 657/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:08.519218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e28747-a7d7-462e-9a59-314dd71ab337 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:08.519739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e28747-a7d7-462e-9a59-314dd71ab337 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:08.519849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e28747-a7d7-462e-9a59-314dd71ab337 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:08.521587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 669/1326] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:08.528903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da490fe-0819-4536-947b-42ccadc49337 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:08.529305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da490fe-0819-4536-947b-42ccadc49337 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:08.529486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da490fe-0819-4536-947b-42ccadc49337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:08.594189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4da490fe-0819-4536-947b-42ccadc49337 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:08.595377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4da490fe-0819-4536-947b-42ccadc49337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:08.696906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 658/1327] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:08.974299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e28747-a7d7-462e-9a59-314dd71ab337 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:08.975831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-91e28747-a7d7-462e-9a59-314dd71ab337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:09.037505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:09.080974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e28747-a7d7-462e-9a59-314dd71ab337 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:09.155449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac923a-5f78-420c-8c83-eb5bc134f5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:09.156061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac923a-5f78-420c-8c83-eb5bc134f5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:09.156345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac923a-5f78-420c-8c83-eb5bc134f5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:09.156647 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac923a-5f78-420c-8c83-eb5bc134f5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:09.158225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-feac923a-5f78-420c-8c83-eb5bc134f5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:09.265377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:09.267686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac923a-5f78-420c-8c83-eb5bc134f5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:09.269669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac923a-5f78-420c-8c83-eb5bc134f5f6 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:09.289269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 670/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:11.276232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784c4c-8267-4da5-aa68-175324974729 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:11.276811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784c4c-8267-4da5-aa68-175324974729 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:11.277645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784c4c-8267-4da5-aa68-175324974729 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:11.279024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 659/1329] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:11.284568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f9649-44b5-449a-88db-6ca04e935d19 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:11.285085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f9649-44b5-449a-88db-6ca04e935d19 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:11.285182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f9649-44b5-449a-88db-6ca04e935d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:11.356617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-034f9649-44b5-449a-88db-6ca04e935d19 None None] MFA Rules not processed for user `cf36f62c4afc473fb33769cbc076b8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:11.357831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-034f9649-44b5-449a-88db-6ca04e935d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:11.457666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 671/1330] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:22:11.737742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784c4c-8267-4da5-aa68-175324974729 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:11.739276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7c784c4c-8267-4da5-aa68-175324974729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:11.770410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:11.846144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784c4c-8267-4da5-aa68-175324974729 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:11.921759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a250a72-5d36-477c-aa86-df7c69318aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:11.922375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a250a72-5d36-477c-aa86-df7c69318aac service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:11.922646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a250a72-5d36-477c-aa86-df7c69318aac service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:11.922913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a250a72-5d36-477c-aa86-df7c69318aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:11.924623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9a250a72-5d36-477c-aa86-df7c69318aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:12.006413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:12.040052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a250a72-5d36-477c-aa86-df7c69318aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:12.041532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a250a72-5d36-477c-aa86-df7c69318aac service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:12.060437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 660/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:14.464602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491baab1-53c2-4e73-9fec-3fb6e9885b1b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:14.465118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491baab1-53c2-4e73-9fec-3fb6e9885b1b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:14.465118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491baab1-53c2-4e73-9fec-3fb6e9885b1b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:14.466433 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 672/1332] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:14.471662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6078ba-afb1-413d-8954-4446366753dc None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:14.472081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6078ba-afb1-413d-8954-4446366753dc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:14.472198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6078ba-afb1-413d-8954-4446366753dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:14.536359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-be6078ba-afb1-413d-8954-4446366753dc None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:14.537572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-be6078ba-afb1-413d-8954-4446366753dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:14.630320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 661/1333] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:22:14.917716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491baab1-53c2-4e73-9fec-3fb6e9885b1b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:14.919276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-491baab1-53c2-4e73-9fec-3fb6e9885b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:14.987521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:15.022192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491baab1-53c2-4e73-9fec-3fb6e9885b1b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:15.096109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2eb92-3dbe-42ba-a398-192c95b1ae81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:15.096762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eb92-3dbe-42ba-a398-192c95b1ae81 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:15.097034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eb92-3dbe-42ba-a398-192c95b1ae81 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:15.097297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eb92-3dbe-42ba-a398-192c95b1ae81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:15.099139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e2a2eb92-3dbe-42ba-a398-192c95b1ae81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:15.206560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2eb92-3dbe-42ba-a398-192c95b1ae81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:15.207994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2eb92-3dbe-42ba-a398-192c95b1ae81 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:15.217700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:15.226284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 673/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:17.153648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d822b-1950-429e-aeb0-503f63de957e None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:17.154185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d822b-1950-429e-aeb0-503f63de957e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:17.154185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d822b-1950-429e-aeb0-503f63de957e None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:17.155524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 662/1335] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:17.160734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a90fd-84af-461f-b145-1eb03545a2b5 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:17.161174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a90fd-84af-461f-b145-1eb03545a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:17.161299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a90fd-84af-461f-b145-1eb03545a2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:17.226307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a51a90fd-84af-461f-b145-1eb03545a2b5 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:17.227501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a51a90fd-84af-461f-b145-1eb03545a2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:17.323103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 674/1336] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:22:17.609314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d822b-1950-429e-aeb0-503f63de957e None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:17.610841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2d9d822b-1950-429e-aeb0-503f63de957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:17.650167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:17.712936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d822b-1950-429e-aeb0-503f63de957e None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:17.783508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4722f8-f388-4758-96e5-5af33b38bf7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:17.784053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4722f8-f388-4758-96e5-5af33b38bf7b service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:17.784308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4722f8-f388-4758-96e5-5af33b38bf7b service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:17.784598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4722f8-f388-4758-96e5-5af33b38bf7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:17.786146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9f4722f8-f388-4758-96e5-5af33b38bf7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:17.868075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:17.894067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4722f8-f388-4758-96e5-5af33b38bf7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:17.895503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4722f8-f388-4758-96e5-5af33b38bf7b service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:17.912977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 663/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:20.254888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a7dae-555a-4451-a090-9d212ff0c039 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:20.255380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a7dae-555a-4451-a090-9d212ff0c039 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:20.255479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a7dae-555a-4451-a090-9d212ff0c039 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:20.257316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 675/1338] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:20.262454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcbe05-bbea-4732-a8af-f2ddc0709879 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:20.262854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcbe05-bbea-4732-a8af-f2ddc0709879 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:20.263005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcbe05-bbea-4732-a8af-f2ddc0709879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:20.327807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-13bcbe05-bbea-4732-a8af-f2ddc0709879 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:20.329047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-13bcbe05-bbea-4732-a8af-f2ddc0709879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:20.421537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 664/1339] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:20.708711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a7dae-555a-4451-a090-9d212ff0c039 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:20.710243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d54a7dae-555a-4451-a090-9d212ff0c039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:20.784328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:20.812640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a7dae-555a-4451-a090-9d212ff0c039 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:20.884357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548d5f-5088-4f7a-9210-df1440269210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:20.884978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548d5f-5088-4f7a-9210-df1440269210 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:20.885252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548d5f-5088-4f7a-9210-df1440269210 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:20.885516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548d5f-5088-4f7a-9210-df1440269210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:20.887076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b6548d5f-5088-4f7a-9210-df1440269210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:20.992835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6548d5f-5088-4f7a-9210-df1440269210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:20.994248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6548d5f-5088-4f7a-9210-df1440269210 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:21.011898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 676/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:24.896910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f8d58-d69e-421b-969b-437ab953f92f None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:24.897460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f8d58-d69e-421b-969b-437ab953f92f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:24.897460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f8d58-d69e-421b-969b-437ab953f92f None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:24.898810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 665/1341] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:24.904018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957b831-84e8-44fc-b1de-ecbe3ffafd5d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:24.904434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957b831-84e8-44fc-b1de-ecbe3ffafd5d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:24.904723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957b831-84e8-44fc-b1de-ecbe3ffafd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:24.910186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:24.976558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5957b831-84e8-44fc-b1de-ecbe3ffafd5d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:24.977901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5957b831-84e8-44fc-b1de-ecbe3ffafd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:25.092957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 677/1342] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:25.377619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f8d58-d69e-421b-969b-437ab953f92f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:25.379145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d48f8d58-d69e-421b-969b-437ab953f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:25.427968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:25.484301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f8d58-d69e-421b-969b-437ab953f92f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:25.560485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b6545-fb83-4e2e-9511-c12eae228570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:25.561089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6545-fb83-4e2e-9511-c12eae228570 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:25.561361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6545-fb83-4e2e-9511-c12eae228570 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:25.561633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6545-fb83-4e2e-9511-c12eae228570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:25.563208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-771b6545-fb83-4e2e-9511-c12eae228570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:25.655790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:25.672107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b6545-fb83-4e2e-9511-c12eae228570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:25.673593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b6545-fb83-4e2e-9511-c12eae228570 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:25.692131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 666/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:28.188700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d9de-3d04-4385-9375-a9e5b2f68372 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:28.189248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d9de-3d04-4385-9375-a9e5b2f68372 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:28.189248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d9de-3d04-4385-9375-a9e5b2f68372 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:28.190599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 678/1344] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:28.196801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5db5e1-8fc5-490c-b17a-808681e2dc72 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:28.197366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5db5e1-8fc5-490c-b17a-808681e2dc72 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:28.197366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5db5e1-8fc5-490c-b17a-808681e2dc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:28.267533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5f5db5e1-8fc5-490c-b17a-808681e2dc72 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:28.268771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5f5db5e1-8fc5-490c-b17a-808681e2dc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:28.364978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 667/1345] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:28.645360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d9de-3d04-4385-9375-a9e5b2f68372 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:28.647489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c6b3d9de-3d04-4385-9375-a9e5b2f68372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:28.735278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:28.753350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d9de-3d04-4385-9375-a9e5b2f68372 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:28.828654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9851c7a-9387-40d5-a204-7f1a4c0732f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:28.829254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851c7a-9387-40d5-a204-7f1a4c0732f2 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:28.829526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851c7a-9387-40d5-a204-7f1a4c0732f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:28.829791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851c7a-9387-40d5-a204-7f1a4c0732f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:28.831353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c9851c7a-9387-40d5-a204-7f1a4c0732f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:28.944867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9851c7a-9387-40d5-a204-7f1a4c0732f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:28.946410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9851c7a-9387-40d5-a204-7f1a4c0732f2 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:28.964761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 679/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:32.761629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166818f-9aba-4729-b6dd-3d8d5cbbfcd0 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:32.762088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166818f-9aba-4729-b6dd-3d8d5cbbfcd0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:32.762170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166818f-9aba-4729-b6dd-3d8d5cbbfcd0 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:32.763561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 668/1347] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:32.769010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edfb76-6d06-4508-b06e-fbbdc1e2e732 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:32.769415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edfb76-6d06-4508-b06e-fbbdc1e2e732 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:32.769568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edfb76-6d06-4508-b06e-fbbdc1e2e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:32.785313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:32.839975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-29edfb76-6d06-4508-b06e-fbbdc1e2e732 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:32.841224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-29edfb76-6d06-4508-b06e-fbbdc1e2e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:32.958777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 680/1348] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:33.245781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166818f-9aba-4729-b6dd-3d8d5cbbfcd0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:33.247304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6166818f-9aba-4729-b6dd-3d8d5cbbfcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:33.308556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:33.357446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166818f-9aba-4729-b6dd-3d8d5cbbfcd0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:33.431409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1a071-f578-4356-80d0-706262868354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:33.432012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1a071-f578-4356-80d0-706262868354 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:33.432284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1a071-f578-4356-80d0-706262868354 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:33.432580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1a071-f578-4356-80d0-706262868354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:33.434197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e0d1a071-f578-4356-80d0-706262868354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:33.546794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:33.550960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1a071-f578-4356-80d0-706262868354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:33.552409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1a071-f578-4356-80d0-706262868354 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:33.570540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 669/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:38.435192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89b8e-12c2-4f05-9ca2-87309cc97577 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:38.435192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89b8e-12c2-4f05-9ca2-87309cc97577 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:38.435192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89b8e-12c2-4f05-9ca2-87309cc97577 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:38.439032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 681/1350] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:22:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:38.446116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b0e07-eeef-4b4d-9b7d-49625fa197e7 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:38.447027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b0e07-eeef-4b4d-9b7d-49625fa197e7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:38.447525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b0e07-eeef-4b4d-9b7d-49625fa197e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:38.551716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d86b0e07-eeef-4b4d-9b7d-49625fa197e7 None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:38.553163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d86b0e07-eeef-4b4d-9b7d-49625fa197e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:38.735362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 670/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:22:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:22:42.838673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd413-dcdd-4ae6-9687-5ac83939c528 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:42.839269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd413-dcdd-4ae6-9687-5ac83939c528 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:42.839269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd413-dcdd-4ae6-9687-5ac83939c528 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:42.840466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 682/1352] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:42.845622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d9ca-c542-4e58-b42d-7afb34ddeee5 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:42.846471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d9ca-c542-4e58-b42d-7afb34ddeee5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:42.847245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d9ca-c542-4e58-b42d-7afb34ddeee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:42.910249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:42.936683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-3cc4d9ca-c542-4e58-b42d-7afb34ddeee5 None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:42.938031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3cc4d9ca-c542-4e58-b42d-7afb34ddeee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:42.955148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=59 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:43.056990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 671/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:44.412854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b946d1-22b8-4572-ba91-43b860439844 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:44.413431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b946d1-22b8-4572-ba91-43b860439844 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:44.413431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b946d1-22b8-4572-ba91-43b860439844 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:44.414736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 683/1354] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:44.419745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a7bc-51df-4548-9462-29792e31d64d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:44.420157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a7bc-51df-4548-9462-29792e31d64d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:44.420321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a7bc-51df-4548-9462-29792e31d64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:44.498244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a196a7bc-51df-4548-9462-29792e31d64d None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:44.499367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a196a7bc-51df-4548-9462-29792e31d64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:44.545063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:44.611943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 672/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:22:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:22:47.950363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a0cec-41fd-40ed-b081-7ee31eb53511 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:47.951106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a0cec-41fd-40ed-b081-7ee31eb53511 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:47.951106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a0cec-41fd-40ed-b081-7ee31eb53511 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:47.952241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 684/1356] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:47.957897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe13a-d6c0-48e6-b4e3-235ce9ed278a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:47.958993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe13a-d6c0-48e6-b4e3-235ce9ed278a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:47.959082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe13a-d6c0-48e6-b4e3-235ce9ed278a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:48.042242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d51fe13a-d6c0-48e6-b4e3-235ce9ed278a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:48.045173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d51fe13a-d6c0-48e6-b4e3-235ce9ed278a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:48.150799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 673/1357] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:48.457411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1528-f4f1-442b-97b6-432c91bd8aa2 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:48.458750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1528-f4f1-442b-97b6-432c91bd8aa2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:48.459293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1528-f4f1-442b-97b6-432c91bd8aa2 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:48.461417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 685/1358] 10.222.0.13 () {54 vars in 962 bytes} [Thu Sep 1 00:22:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:48.471510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba23ab6-d5e5-4892-9d07-e1ddfaf1b138 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:48.473283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba23ab6-d5e5-4892-9d07-e1ddfaf1b138 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:48.474988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba23ab6-d5e5-4892-9d07-e1ddfaf1b138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:48.495911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:48.570702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-8ba23ab6-d5e5-4892-9d07-e1ddfaf1b138 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:48.572331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8ba23ab6-d5e5-4892-9d07-e1ddfaf1b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:48.696222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 674/1359] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Sep 1 00:22:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:22:48.705077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1528-f4f1-442b-97b6-432c91bd8aa2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:48.706771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ab3d1528-f4f1-442b-97b6-432c91bd8aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:48.856536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1528-f4f1-442b-97b6-432c91bd8aa2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:48.937155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:48.978037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa7499-75e3-4487-b7e8-4c0c1f49df20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:48.979930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7499-75e3-4487-b7e8-4c0c1f49df20 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:48.979930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7499-75e3-4487-b7e8-4c0c1f49df20 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:48.979930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7499-75e3-4487-b7e8-4c0c1f49df20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:48.980775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b8fa7499-75e3-4487-b7e8-4c0c1f49df20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:49.072107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa7499-75e3-4487-b7e8-4c0c1f49df20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:49.073656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa7499-75e3-4487-b7e8-4c0c1f49df20 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:49.092062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 686/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:51.238253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f459d-1fef-454a-9703-7bbfb8f75ff2 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:51.238783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f459d-1fef-454a-9703-7bbfb8f75ff2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:51.238783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f459d-1fef-454a-9703-7bbfb8f75ff2 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:51.240859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 675/1361] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:51.246002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0504-773f-48e0-ac78-a1207e31f854 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:51.246428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0504-773f-48e0-ac78-a1207e31f854 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:51.246540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0504-773f-48e0-ac78-a1207e31f854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:51.315407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1b6b0504-773f-48e0-ac78-a1207e31f854 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:51.317115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1b6b0504-773f-48e0-ac78-a1207e31f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:51.361506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:51.434399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 687/1362] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:51.723554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f459d-1fef-454a-9703-7bbfb8f75ff2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:51.725282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-235f459d-1fef-454a-9703-7bbfb8f75ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:51.795624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:51.893417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f459d-1fef-454a-9703-7bbfb8f75ff2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:52.021373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3579c-2118-4b9b-b43c-09fafd0b96e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:52.022003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3579c-2118-4b9b-b43c-09fafd0b96e9 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:52.022288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3579c-2118-4b9b-b43c-09fafd0b96e9 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:52.022558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3579c-2118-4b9b-b43c-09fafd0b96e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:52.024900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-27a3579c-2118-4b9b-b43c-09fafd0b96e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:52.049352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:52.123832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3579c-2118-4b9b-b43c-09fafd0b96e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:52.125479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3579c-2118-4b9b-b43c-09fafd0b96e9 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:52.146964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 676/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:54.468196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96e779-41f4-43f6-9c24-949c00b15117 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:54.468824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96e779-41f4-43f6-9c24-949c00b15117 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:54.468824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96e779-41f4-43f6-9c24-949c00b15117 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:54.470131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 688/1364] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:54.476355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc985cfe-b2b9-48de-9ad5-658ccc3d7340 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:54.476819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc985cfe-b2b9-48de-9ad5-658ccc3d7340 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:54.476934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc985cfe-b2b9-48de-9ad5-658ccc3d7340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:54.551797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-cc985cfe-b2b9-48de-9ad5-658ccc3d7340 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:54.553024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-cc985cfe-b2b9-48de-9ad5-658ccc3d7340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:54.668532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:54.682343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 677/1365] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:54.959177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d222641-942c-41cb-9a3e-dee6d7733f68 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:54.959786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d222641-942c-41cb-9a3e-dee6d7733f68 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:54.960068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d222641-942c-41cb-9a3e-dee6d7733f68 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:54.961613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 689/1366] 10.222.0.13 () {54 vars in 962 bytes} [Thu Sep 1 00:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:54.967338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe29b0-2c71-46cd-b454-952d035812b3 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:54.967843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe29b0-2c71-46cd-b454-952d035812b3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:54.968212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe29b0-2c71-46cd-b454-952d035812b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:55.048082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0dfe29b0-2c71-46cd-b454-952d035812b3 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:55.049463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0dfe29b0-2c71-46cd-b454-952d035812b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:55.179474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 678/1367] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Sep 1 00:22:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:55.187347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d222641-942c-41cb-9a3e-dee6d7733f68 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:55.189149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1d222641-942c-41cb-9a3e-dee6d7733f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:55.350607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d222641-942c-41cb-9a3e-dee6d7733f68 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:55.372189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:55.477177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d11dc1-3e30-450b-b226-0d933bd6d838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:55.477866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11dc1-3e30-450b-b226-0d933bd6d838 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:55.478143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11dc1-3e30-450b-b226-0d933bd6d838 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:55.478331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11dc1-3e30-450b-b226-0d933bd6d838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:55.480075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-63d11dc1-3e30-450b-b226-0d933bd6d838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:55.578467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d11dc1-3e30-450b-b226-0d933bd6d838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:55.580083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d11dc1-3e30-450b-b226-0d933bd6d838 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:55.599506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 690/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:56.026108 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed4a8-d89c-4512-a380-7867d70d0664 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:56.026651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed4a8-d89c-4512-a380-7867d70d0664 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:56.026651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed4a8-d89c-4512-a380-7867d70d0664 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:56.028128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 679/1369] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:56.033042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88746a3d-1310-4f12-9eee-769ed7967006 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:56.033333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88746a3d-1310-4f12-9eee-769ed7967006 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:56.033608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88746a3d-1310-4f12-9eee-769ed7967006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:56.067022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:56.104197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-88746a3d-1310-4f12-9eee-769ed7967006 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:56.105472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-88746a3d-1310-4f12-9eee-769ed7967006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:56.208439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 691/1370] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:56.790997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216e4c-af5c-41b2-9185-5ef1aa8681d7 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:56.790997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216e4c-af5c-41b2-9185-5ef1aa8681d7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:56.790997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216e4c-af5c-41b2-9185-5ef1aa8681d7 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:56.792176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 680/1371] 10.222.0.13 () {54 vars in 964 bytes} [Thu Sep 1 00:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:56.796964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bde8e8-2f1e-4908-90ea-30ac6e30f3a4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:56.797521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bde8e8-2f1e-4908-90ea-30ac6e30f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:56.797521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bde8e8-2f1e-4908-90ea-30ac6e30f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:56.875533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b8bde8e8-2f1e-4908-90ea-30ac6e30f3a4 None None] MFA Rules not processed for user `b5a31dd48b6b4377a0eb375502344dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:56.876816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b8bde8e8-2f1e-4908-90ea-30ac6e30f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:56.927709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:56.959113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 692/1372] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Sep 1 00:22:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:56.966575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216e4c-af5c-41b2-9185-5ef1aa8681d7 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:56.968086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fb216e4c-af5c-41b2-9185-5ef1aa8681d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:57.020982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:57.076643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216e4c-af5c-41b2-9185-5ef1aa8681d7 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:57.155617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae8c4f-c8f7-417a-80f3-f82d96bfa1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:57.156223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8c4f-c8f7-417a-80f3-f82d96bfa1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:57.156563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8c4f-c8f7-417a-80f3-f82d96bfa1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:57.156832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8c4f-c8f7-417a-80f3-f82d96bfa1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:57.158444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-54ae8c4f-c8f7-417a-80f3-f82d96bfa1c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:57.261004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:57.278094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae8c4f-c8f7-417a-80f3-f82d96bfa1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:57.279589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae8c4f-c8f7-417a-80f3-f82d96bfa1c1 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:57.299165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 681/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:22:57.603864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638df6-48be-4bd7-885f-5ff505ec3ad2 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:57.604074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638df6-48be-4bd7-885f-5ff505ec3ad2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:57.604322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638df6-48be-4bd7-885f-5ff505ec3ad2 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:57.605710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 693/1374] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:22:57.611782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676505-dfca-433d-b941-bdfb05a31adb None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:57.612069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676505-dfca-433d-b941-bdfb05a31adb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:57.612343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676505-dfca-433d-b941-bdfb05a31adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:57.679156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-54676505-dfca-433d-b941-bdfb05a31adb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:22:57.680377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-54676505-dfca-433d-b941-bdfb05a31adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:57.776188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 682/1375] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:22:58.068158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638df6-48be-4bd7-885f-5ff505ec3ad2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:22:58.069867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ad638df6-48be-4bd7-885f-5ff505ec3ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:58.215760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638df6-48be-4bd7-885f-5ff505ec3ad2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:22:58.267237 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:58.330463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9b71-52f0-4b66-8dfa-a4d06870e22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:22:58.331067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9b71-52f0-4b66-8dfa-a4d06870e22d service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:22:58.331343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9b71-52f0-4b66-8dfa-a4d06870e22d service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:22:58.331616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9b71-52f0-4b66-8dfa-a4d06870e22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:22:58.333824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-763e9b71-52f0-4b66-8dfa-a4d06870e22d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:22:58.422736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e9b71-52f0-4b66-8dfa-a4d06870e22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:22:58.424338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e9b71-52f0-4b66-8dfa-a4d06870e22d service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:22:58.441760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 694/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:00.410822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357595-7866-4dda-8c72-79b482f7aeec None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:00.411308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357595-7866-4dda-8c72-79b482f7aeec None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:00.411308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357595-7866-4dda-8c72-79b482f7aeec None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:00.412650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 683/1377] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:00.417795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbcba-09d4-433e-adb0-1afae57e091b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:00.418241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbcba-09d4-433e-adb0-1afae57e091b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:00.418374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbcba-09d4-433e-adb0-1afae57e091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:00.486081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-146bbcba-09d4-433e-adb0-1afae57e091b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:00.487187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-146bbcba-09d4-433e-adb0-1afae57e091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:00.494329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:00.595302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 695/1378] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:00.889739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28357595-7866-4dda-8c72-79b482f7aeec None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:00.891226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-28357595-7866-4dda-8c72-79b482f7aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:00.955220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:01.047227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28357595-7866-4dda-8c72-79b482f7aeec None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:01.171378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1bbc6-d543-4d43-b916-72571ecf9b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:01.171897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bbc6-d543-4d43-b916-72571ecf9b90 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:01.172176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bbc6-d543-4d43-b916-72571ecf9b90 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:01.172480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bbc6-d543-4d43-b916-72571ecf9b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:01.174075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0ba1bbc6-d543-4d43-b916-72571ecf9b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:01.194715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:01.269253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1bbc6-d543-4d43-b916-72571ecf9b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:01.270899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1bbc6-d543-4d43-b916-72571ecf9b90 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:01.290415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 684/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:03.223737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64dcf7-c0e6-43eb-908c-46e5bc20d0e4 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:03.224344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64dcf7-c0e6-43eb-908c-46e5bc20d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:03.224344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64dcf7-c0e6-43eb-908c-46e5bc20d0e4 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:03.225834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 696/1380] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:03.230950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093541b0-7537-414e-8a47-5419be687c63 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:03.231387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093541b0-7537-414e-8a47-5419be687c63 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:03.231492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093541b0-7537-414e-8a47-5419be687c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:03.304334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-093541b0-7537-414e-8a47-5419be687c63 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:03.305953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-093541b0-7537-414e-8a47-5419be687c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:03.407841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:03.415926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 685/1381] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:03.710321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64dcf7-c0e6-43eb-908c-46e5bc20d0e4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:03.711823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-eb64dcf7-c0e6-43eb-908c-46e5bc20d0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:03.860460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:03.874291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64dcf7-c0e6-43eb-908c-46e5bc20d0e4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:03.995648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15face0-9f17-4da2-ae21-cf028dd902f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:03.996178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15face0-9f17-4da2-ae21-cf028dd902f7 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:03.996492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15face0-9f17-4da2-ae21-cf028dd902f7 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:03.996771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15face0-9f17-4da2-ae21-cf028dd902f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:03.998380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c15face0-9f17-4da2-ae21-cf028dd902f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:04.093682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15face0-9f17-4da2-ae21-cf028dd902f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:04.095310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15face0-9f17-4da2-ae21-cf028dd902f7 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:04.106338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:04.116603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 697/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:06.070297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1098f0-307a-471f-a595-8d57598d8f7f None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:06.070844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1098f0-307a-471f-a595-8d57598d8f7f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:06.070969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1098f0-307a-471f-a595-8d57598d8f7f None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:06.072780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 686/1383] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:06.077835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e131-0b12-4d5d-9a10-b3e59cc95fbf None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:06.078234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e131-0b12-4d5d-9a10-b3e59cc95fbf None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:06.078381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e131-0b12-4d5d-9a10-b3e59cc95fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:06.153169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7f04e131-0b12-4d5d-9a10-b3e59cc95fbf None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:06.154781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7f04e131-0b12-4d5d-9a10-b3e59cc95fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:06.267896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 698/1384] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:23:06.639078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1098f0-307a-471f-a595-8d57598d8f7f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:06.640690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bf1098f0-307a-471f-a595-8d57598d8f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:06.809896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1098f0-307a-471f-a595-8d57598d8f7f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:06.883277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:06.931951 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644fcb9-63e9-4263-b895-a2d06fb4497c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:06.932607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644fcb9-63e9-4263-b895-a2d06fb4497c service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:06.932899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644fcb9-63e9-4263-b895-a2d06fb4497c service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:06.933174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644fcb9-63e9-4263-b895-a2d06fb4497c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:06.934869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2644fcb9-63e9-4263-b895-a2d06fb4497c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:07.034896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644fcb9-63e9-4263-b895-a2d06fb4497c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:07.036547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644fcb9-63e9-4263-b895-a2d06fb4497c service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:07.054920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 687/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:08.954426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473d20-690a-4304-8318-fb0786a0c3dd None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:08.954965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473d20-690a-4304-8318-fb0786a0c3dd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:08.954965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473d20-690a-4304-8318-fb0786a0c3dd None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:08.956391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 699/1386] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:08.962484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906e54-a417-4043-8591-f4dd1cde7080 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:08.962904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906e54-a417-4043-8591-f4dd1cde7080 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:08.963019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906e54-a417-4043-8591-f4dd1cde7080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:09.031205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-31906e54-a417-4043-8591-f4dd1cde7080 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:09.032501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-31906e54-a417-4043-8591-f4dd1cde7080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:09.065720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:09.133944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 688/1387] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:09.431782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5473d20-690a-4304-8318-fb0786a0c3dd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:09.433325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e5473d20-690a-4304-8318-fb0786a0c3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:09.509030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:09.595549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5473d20-690a-4304-8318-fb0786a0c3dd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:09.710160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbc170-aeb8-4723-9eab-1d10542c3435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:09.710772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc170-aeb8-4723-9eab-1d10542c3435 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:09.711051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc170-aeb8-4723-9eab-1d10542c3435 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:09.711333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc170-aeb8-4723-9eab-1d10542c3435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:09.712978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d0dbc170-aeb8-4723-9eab-1d10542c3435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:09.751777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:09.802570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbc170-aeb8-4723-9eab-1d10542c3435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:09.804240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbc170-aeb8-4723-9eab-1d10542c3435 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:09.821901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 700/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:11.744479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f3165-10c7-44c9-96d3-0140f58efd92 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:11.745030 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f3165-10c7-44c9-96d3-0140f58efd92 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:11.745179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f3165-10c7-44c9-96d3-0140f58efd92 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:11.746636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 689/1389] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:11.751642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b0de-c2db-4311-8218-863bff568dff None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:11.752041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b0de-c2db-4311-8218-863bff568dff None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:11.752227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b0de-c2db-4311-8218-863bff568dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:11.819409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4e64b0de-c2db-4311-8218-863bff568dff None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:11.820591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4e64b0de-c2db-4311-8218-863bff568dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:11.918176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 701/1390] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:12.218460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f3165-10c7-44c9-96d3-0140f58efd92 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:12.220048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3d9f3165-10c7-44c9-96d3-0140f58efd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:12.369901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f3165-10c7-44c9-96d3-0140f58efd92 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:12.387943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:12.485248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c95a4-5393-4903-a3ec-44976a6b7cf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:12.485772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c95a4-5393-4903-a3ec-44976a6b7cf7 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:12.486045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c95a4-5393-4903-a3ec-44976a6b7cf7 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:12.486310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c95a4-5393-4903-a3ec-44976a6b7cf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:12.488490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-554c95a4-5393-4903-a3ec-44976a6b7cf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:12.580604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c95a4-5393-4903-a3ec-44976a6b7cf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:12.582404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c95a4-5393-4903-a3ec-44976a6b7cf7 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:12.602493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 690/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:14.791133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace55c-6be1-4450-a62c-237bc28a88f0 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:14.791698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace55c-6be1-4450-a62c-237bc28a88f0 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:14.791698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace55c-6be1-4450-a62c-237bc28a88f0 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:14.793554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 702/1392] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:14.798832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed422-e26f-4a9b-8a14-a42016023235 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:14.799266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed422-e26f-4a9b-8a14-a42016023235 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:14.799436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed422-e26f-4a9b-8a14-a42016023235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:14.827831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:14.869838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f8bed422-e26f-4a9b-8a14-a42016023235 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:14.871030 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f8bed422-e26f-4a9b-8a14-a42016023235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:14.972846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 691/1393] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:23:15.263902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ace55c-6be1-4450-a62c-237bc28a88f0 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:15.265567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a8ace55c-6be1-4450-a62c-237bc28a88f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:15.279904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:15.417809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ace55c-6be1-4450-a62c-237bc28a88f0 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:15.503294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:15.532526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969efbc7-776f-4b79-8727-a0ba4157cba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:15.533142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969efbc7-776f-4b79-8727-a0ba4157cba2 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:15.533425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969efbc7-776f-4b79-8727-a0ba4157cba2 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:15.533698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969efbc7-776f-4b79-8727-a0ba4157cba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:15.535332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-969efbc7-776f-4b79-8727-a0ba4157cba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:15.642082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969efbc7-776f-4b79-8727-a0ba4157cba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:15.644581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969efbc7-776f-4b79-8727-a0ba4157cba2 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:15.665161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 703/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:17.593031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a91b66-e37b-413d-8ab1-31c7c3238d73 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:17.593612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a91b66-e37b-413d-8ab1-31c7c3238d73 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:17.593612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a91b66-e37b-413d-8ab1-31c7c3238d73 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:17.594920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 692/1395] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:17.601295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:17.601738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:17.601866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:17.670396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:17.671599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:17.732357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:17.767168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf13a-eff7-4b9a-b88b-38f468739728 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:17.767445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf13a-eff7-4b9a-b88b-38f468739728 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:17.767713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf13a-eff7-4b9a-b88b-38f468739728 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:17.769157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 693/1396] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:23:17.773974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752bbe-ef6f-42b8-a154-653ab7472445 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:17.774254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752bbe-ef6f-42b8-a154-653ab7472445 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:17.774656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752bbe-ef6f-42b8-a154-653ab7472445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:17.782077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 704/1397] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:17.839944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7f752bbe-ef6f-42b8-a154-653ab7472445 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:17.841165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7f752bbe-ef6f-42b8-a154-653ab7472445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:17.891978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:17.939516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 694/1398] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:23:18.086312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:18.087539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:18.202387 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7488-e7c7-48a7-9513-5e77c1971b6e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:18.251327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972719f-5f3e-49e8-a768-7b40a49890c0 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:18.251647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972719f-5f3e-49e8-a768-7b40a49890c0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:18.251856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972719f-5f3e-49e8-a768-7b40a49890c0 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:18.254035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 695/1399] 10.222.0.13 () {54 vars in 967 bytes} [Thu Sep 1 00:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 00:23:18.258795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09ff4f-ac94-402a-a930-63fd08783b32 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:18.259074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09ff4f-ac94-402a-a930-63fd08783b32 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:18.259349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09ff4f-ac94-402a-a930-63fd08783b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:18.276310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:18.336101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76a6a-67da-4a9a-beb1-b6b9f8110b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:18.336681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76a6a-67da-4a9a-beb1-b6b9f8110b77 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:18.336965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76a6a-67da-4a9a-beb1-b6b9f8110b77 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:18.337226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76a6a-67da-4a9a-beb1-b6b9f8110b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:18.338822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-faf76a6a-67da-4a9a-beb1-b6b9f8110b77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:18.342884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ee09ff4f-ac94-402a-a930-63fd08783b32 None None] MFA Rules not processed for user `fae893320e6c4ab996cdc2230172417e`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:18.344238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ee09ff4f-ac94-402a-a930-63fd08783b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:18.433152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 696/1400] 10.222.0.13 () {58 vars in 1064 bytes} [Thu Sep 1 00:23:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:23:18.437171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf76a6a-67da-4a9a-beb1-b6b9f8110b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:18.438829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf76a6a-67da-4a9a-beb1-b6b9f8110b77 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:18.441766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09ff4f-ac94-402a-a930-63fd08783b32 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:18.449020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09ff4f-ac94-402a-a930-63fd08783b32 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:18.458279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 705/1401] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:18.496900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:18.538041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153f4b3-7b30-4405-872b-6939bd439efa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:18.538673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153f4b3-7b30-4405-872b-6939bd439efa service glance] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:18.538956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153f4b3-7b30-4405-872b-6939bd439efa service glance] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:18.539232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153f4b3-7b30-4405-872b-6939bd439efa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:18.540990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4153f4b3-7b30-4405-872b-6939bd439efa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:18.666215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153f4b3-7b30-4405-872b-6939bd439efa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:18.667617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153f4b3-7b30-4405-872b-6939bd439efa service glance] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:18.686318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 697/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:23:19.414040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632e0b-313b-412a-9b2c-8d5633d7abcb None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:19.414554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632e0b-313b-412a-9b2c-8d5633d7abcb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:19.414660 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632e0b-313b-412a-9b2c-8d5633d7abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:19.481082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-bd632e0b-313b-412a-9b2c-8d5633d7abcb None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:19.482277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bd632e0b-313b-412a-9b2c-8d5633d7abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:19.505320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:19.582242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 706/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:23:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:19.627757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71c2a3-e726-403a-8cbd-9aead2b1ebbb None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:19.628086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71c2a3-e726-403a-8cbd-9aead2b1ebbb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:19.628895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71c2a3-e726-403a-8cbd-9aead2b1ebbb None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:19.630274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 698/1404] 10.222.0.13 () {54 vars in 943 bytes} [Thu Sep 1 00:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:19.636525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9e8f-f3b0-4bf6-932c-51369d453885 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:19.636885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9e8f-f3b0-4bf6-932c-51369d453885 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:19.637229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9e8f-f3b0-4bf6-932c-51369d453885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:19.713964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7bef9e8f-f3b0-4bf6-932c-51369d453885 None None] MFA Rules not processed for user `6f2ae343d97d49be9d3d6b430a61a48f`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:19.715159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7bef9e8f-f3b0-4bf6-932c-51369d453885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:19.816408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:19.823802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 707/1405] 10.222.0.13 () {58 vars in 1040 bytes} [Thu Sep 1 00:23:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:19.833415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71c2a3-e726-403a-8cbd-9aead2b1ebbb None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:19.834999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ec71c2a3-e726-403a-8cbd-9aead2b1ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:19.908471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:19.973480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71c2a3-e726-403a-8cbd-9aead2b1ebbb None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:20.084979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf211-e831-42bd-bf7d-9faf479aea2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:20.085686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf211-e831-42bd-bf7d-9faf479aea2f service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:20.085961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf211-e831-42bd-bf7d-9faf479aea2f service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:20.086230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf211-e831-42bd-bf7d-9faf479aea2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:20.087857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a13bf211-e831-42bd-bf7d-9faf479aea2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:20.143633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:20.173942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf211-e831-42bd-bf7d-9faf479aea2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:20.176043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf211-e831-42bd-bf7d-9faf479aea2f service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:20.184033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 699/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:23:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:23:20.395942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c5d4-2191-4449-b594-3cb8202d124a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:20.396325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c5d4-2191-4449-b594-3cb8202d124a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:20.396740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c5d4-2191-4449-b594-3cb8202d124a None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:20.398214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 708/1407] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:20.403343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8bbc8-4744-4ab7-8f87-5e198f92226c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:20.403637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8bbc8-4744-4ab7-8f87-5e198f92226c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:20.403909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8bbc8-4744-4ab7-8f87-5e198f92226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:20.474795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e7c8bbc8-4744-4ab7-8f87-5e198f92226c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:20.476053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e7c8bbc8-4744-4ab7-8f87-5e198f92226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:20.604544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 700/1408] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:20.885199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147c5d4-2191-4449-b594-3cb8202d124a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:20.886716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8147c5d4-2191-4449-b594-3cb8202d124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:21.051618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147c5d4-2191-4449-b594-3cb8202d124a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:21.139368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:21.193828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8068a7-ca29-4067-a2e4-c9c077afe016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:21.194484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8068a7-ca29-4067-a2e4-c9c077afe016 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:21.194766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8068a7-ca29-4067-a2e4-c9c077afe016 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:21.195035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8068a7-ca29-4067-a2e4-c9c077afe016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:21.196840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3a8068a7-ca29-4067-a2e4-c9c077afe016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:21.294857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8068a7-ca29-4067-a2e4-c9c077afe016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:21.298105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8068a7-ca29-4067-a2e4-c9c077afe016 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:21.320515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 709/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:30.595654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=79 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:31.318126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=64 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:42.203405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fe56-8f32-4a10-818c-257e9431789d None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:42.203953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fe56-8f32-4a10-818c-257e9431789d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:42.203953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fe56-8f32-4a10-818c-257e9431789d None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:42.205361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 701/1410] 10.222.0.13 () {54 vars in 918 bytes} [Thu Sep 1 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:42.210593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b428-445d-4fc8-b60c-e12b61445158 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:42.211019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b428-445d-4fc8-b60c-e12b61445158 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:42.211162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b428-445d-4fc8-b60c-e12b61445158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:42.284835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-8744b428-445d-4fc8-b60c-e12b61445158 None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:42.286021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8744b428-445d-4fc8-b60c-e12b61445158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:42.388120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 710/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Sep 1 00:23:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:42.402494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11432-0736-4e9b-815d-381aa2a3e3fc None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:42.402780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11432-0736-4e9b-815d-381aa2a3e3fc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:42.403056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11432-0736-4e9b-815d-381aa2a3e3fc None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:42.404420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 702/1412] 10.222.0.13 () {54 vars in 918 bytes} [Thu Sep 1 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:42.408836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37363-4fc5-4100-9937-99ebc0f60fbc None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:42.409125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37363-4fc5-4100-9937-99ebc0f60fbc None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:42.409398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37363-4fc5-4100-9937-99ebc0f60fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:42.483063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:42.486156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-eeb37363-4fc5-4100-9937-99ebc0f60fbc None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:42.487971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-eeb37363-4fc5-4100-9937-99ebc0f60fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:42.601824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 711/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Sep 1 00:23:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:44.955425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e3b35-128e-4b43-8140-19d62969ef4d None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:44.955994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e3b35-128e-4b43-8140-19d62969ef4d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:44.955994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e3b35-128e-4b43-8140-19d62969ef4d None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:44.957410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:44.962560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32970a-62c9-4e25-9804-02c6bd31c8b4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:44.962978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32970a-62c9-4e25-9804-02c6bd31c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:44.963119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32970a-62c9-4e25-9804-02c6bd31c8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:45.029610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fd32970a-62c9-4e25-9804-02c6bd31c8b4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:45.030811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fd32970a-62c9-4e25-9804-02c6bd31c8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:45.085008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:45.126948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:45.442233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e3b35-128e-4b43-8140-19d62969ef4d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:45.443782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-159e3b35-128e-4b43-8140-19d62969ef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:45.586899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e3b35-128e-4b43-8140-19d62969ef4d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:45.678956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:45.719811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d23d3-40bd-497d-abe7-4f6ebf8e1ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:45.720424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d23d3-40bd-497d-abe7-4f6ebf8e1ea2 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:45.720700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d23d3-40bd-497d-abe7-4f6ebf8e1ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:45.720966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d23d3-40bd-497d-abe7-4f6ebf8e1ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:45.723339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bc2d23d3-40bd-497d-abe7-4f6ebf8e1ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:45.808945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d23d3-40bd-497d-abe7-4f6ebf8e1ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:45.810530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d23d3-40bd-497d-abe7-4f6ebf8e1ea2 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:45.828160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 704/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:46.717095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c7bed-459b-4ba6-b29d-0be20236f4be None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:46.717675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c7bed-459b-4ba6-b29d-0be20236f4be None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:46.717675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c7bed-459b-4ba6-b29d-0be20236f4be None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:46.718974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:46.724907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6a3dc-195f-4ce5-b9ce-d2d8fad05f97 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:46.725332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6a3dc-195f-4ce5-b9ce-d2d8fad05f97 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:46.725456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6a3dc-195f-4ce5-b9ce-d2d8fad05f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:46.798391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-71a6a3dc-195f-4ce5-b9ce-d2d8fad05f97 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:46.799502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-71a6a3dc-195f-4ce5-b9ce-d2d8fad05f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:46.825135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:46.892647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:47.042491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c7bed-459b-4ba6-b29d-0be20236f4be None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:47.044007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9b2c7bed-459b-4ba6-b29d-0be20236f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:47.186394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c7bed-459b-4ba6-b29d-0be20236f4be None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:47.226929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:47.301834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5adc-4406-4ced-9c01-0d02e6e4a1a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:47.302439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5adc-4406-4ced-9c01-0d02e6e4a1a1 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:47.302721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5adc-4406-4ced-9c01-0d02e6e4a1a1 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:47.303009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5adc-4406-4ced-9c01-0d02e6e4a1a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:47.304624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-763d5adc-4406-4ced-9c01-0d02e6e4a1a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:47.392276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5adc-4406-4ced-9c01-0d02e6e4a1a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:47.393951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5adc-4406-4ced-9c01-0d02e6e4a1a1 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:47.412465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 714/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:48.300781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9ade-4c27-48fe-8e80-2a6cd8c93519 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:48.301260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9ade-4c27-48fe-8e80-2a6cd8c93519 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:48.301355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9ade-4c27-48fe-8e80-2a6cd8c93519 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:48.302672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:48.307804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1197ec-d264-4ebe-9b06-a05d8692268a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:48.308211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1197ec-d264-4ebe-9b06-a05d8692268a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:48.308408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1197ec-d264-4ebe-9b06-a05d8692268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:48.361813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:48.384906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5d1197ec-d264-4ebe-9b06-a05d8692268a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:48.386086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5d1197ec-d264-4ebe-9b06-a05d8692268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:48.481331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:48.631475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c9ade-4c27-48fe-8e80-2a6cd8c93519 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:48.632961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-227c9ade-4c27-48fe-8e80-2a6cd8c93519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:48.775074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c9ade-4c27-48fe-8e80-2a6cd8c93519 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:48.786737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:48.887319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160536db-c76f-41db-af2e-fd76c3ebd0bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:48.887851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160536db-c76f-41db-af2e-fd76c3ebd0bd service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:48.888131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160536db-c76f-41db-af2e-fd76c3ebd0bd service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:48.888427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160536db-c76f-41db-af2e-fd76c3ebd0bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:48.890046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-160536db-c76f-41db-af2e-fd76c3ebd0bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:48.978368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160536db-c76f-41db-af2e-fd76c3ebd0bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:48.979978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160536db-c76f-41db-af2e-fd76c3ebd0bd service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:48.998215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 707/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:49.855233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3599ad-b854-4e23-b119-a75efdaf3cfa None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:49.855846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3599ad-b854-4e23-b119-a75efdaf3cfa None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:49.855846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3599ad-b854-4e23-b119-a75efdaf3cfa None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:49.857169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:49.862071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43d20-3348-4b09-82f7-3efad7a43e29 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:49.862471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43d20-3348-4b09-82f7-3efad7a43e29 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:49.862623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d43d20-3348-4b09-82f7-3efad7a43e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:49.881960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:49.936991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-41d43d20-3348-4b09-82f7-3efad7a43e29 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:49.938181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-41d43d20-3348-4b09-82f7-3efad7a43e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:50.035702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:50.184625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3599ad-b854-4e23-b119-a75efdaf3cfa None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:50.186069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1b3599ad-b854-4e23-b119-a75efdaf3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:50.294431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:50.330343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3599ad-b854-4e23-b119-a75efdaf3cfa None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:50.439837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352846-1ceb-4170-838f-1a6ca8e329a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:50.440470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352846-1ceb-4170-838f-1a6ca8e329a5 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:50.440754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352846-1ceb-4170-838f-1a6ca8e329a5 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:50.441613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352846-1ceb-4170-838f-1a6ca8e329a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:50.443224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ff352846-1ceb-4170-838f-1a6ca8e329a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:50.518513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:50.532561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352846-1ceb-4170-838f-1a6ca8e329a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:50.534180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352846-1ceb-4170-838f-1a6ca8e329a5 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:50.552483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 717/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:51.401095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e809e-a433-4b4f-a533-0b8663e66c0e None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:51.401652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e809e-a433-4b4f-a533-0b8663e66c0e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:51.401652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e809e-a433-4b4f-a533-0b8663e66c0e None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:51.402959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:51.408042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c15a-9145-47a6-90d8-6d99a0cc2d21 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:51.408533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c15a-9145-47a6-90d8-6d99a0cc2d21 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:51.408642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3c15a-9145-47a6-90d8-6d99a0cc2d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:51.485518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ccc3c15a-9145-47a6-90d8-6d99a0cc2d21 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:51.486722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ccc3c15a-9145-47a6-90d8-6d99a0cc2d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:51.582333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:51.733666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e809e-a433-4b4f-a533-0b8663e66c0e None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:51.735113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-817e809e-a433-4b4f-a533-0b8663e66c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:51.816631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:51.878174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e809e-a433-4b4f-a533-0b8663e66c0e None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:51.990541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e6b19-3641-4208-beef-ded8a61a812a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:51.991058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e6b19-3641-4208-beef-ded8a61a812a service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:51.991335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e6b19-3641-4208-beef-ded8a61a812a service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:51.991604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e6b19-3641-4208-beef-ded8a61a812a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:51.993213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fe8e6b19-3641-4208-beef-ded8a61a812a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:52.040178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:52.079870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e6b19-3641-4208-beef-ded8a61a812a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:52.081485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e6b19-3641-4208-beef-ded8a61a812a service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:52.100176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 710/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:52.896010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e67dd-76bc-4ae3-a518-a46ab0d3a842 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:52.896575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e67dd-76bc-4ae3-a518-a46ab0d3a842 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:52.896575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e67dd-76bc-4ae3-a518-a46ab0d3a842 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:52.897848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:52.902766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024495e-3023-4d3a-8a8c-7573a075f6a2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:52.903196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024495e-3023-4d3a-8a8c-7573a075f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:52.903318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024495e-3023-4d3a-8a8c-7573a075f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:52.979290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f024495e-3023-4d3a-8a8c-7573a075f6a2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:52.980521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f024495e-3023-4d3a-8a8c-7573a075f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:53.078477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:53.231582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e67dd-76bc-4ae3-a518-a46ab0d3a842 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:53.233132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c25e67dd-76bc-4ae3-a518-a46ab0d3a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:53.282923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:53.380141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e67dd-76bc-4ae3-a518-a46ab0d3a842 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:53.490593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f6bf-a344-4d6c-9030-e9b830859704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:53.491131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f6bf-a344-4d6c-9030-e9b830859704 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:53.491412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f6bf-a344-4d6c-9030-e9b830859704 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:53.491682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f6bf-a344-4d6c-9030-e9b830859704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:53.493296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-75c1f6bf-a344-4d6c-9030-e9b830859704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:53.500324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:53.584509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f6bf-a344-4d6c-9030-e9b830859704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:53.586137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f6bf-a344-4d6c-9030-e9b830859704 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:53.606245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 720/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:54.409392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644e29-d710-4f89-aaaf-2f6e04bacab6 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:54.409921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644e29-d710-4f89-aaaf-2f6e04bacab6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:54.409921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644e29-d710-4f89-aaaf-2f6e04bacab6 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:54.411197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:54.416005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e1e29-d733-40ac-8748-34a6ecb1164b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:54.416454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e1e29-d733-40ac-8748-34a6ecb1164b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:54.416568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e1e29-d733-40ac-8748-34a6ecb1164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:54.492567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4b1e1e29-d733-40ac-8748-34a6ecb1164b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:54.493759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4b1e1e29-d733-40ac-8748-34a6ecb1164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:54.560452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:54.589138 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:54.740259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f644e29-d710-4f89-aaaf-2f6e04bacab6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:54.741806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6f644e29-d710-4f89-aaaf-2f6e04bacab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:54.759941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:54.886887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f644e29-d710-4f89-aaaf-2f6e04bacab6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:54.973727 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:54.999010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314671d-2320-4389-882d-e797a32c17bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:54.999524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314671d-2320-4389-882d-e797a32c17bc service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:54.999795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314671d-2320-4389-882d-e797a32c17bc service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:55.000059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314671d-2320-4389-882d-e797a32c17bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:55.001660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a314671d-2320-4389-882d-e797a32c17bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:55.087488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314671d-2320-4389-882d-e797a32c17bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:55.089118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314671d-2320-4389-882d-e797a32c17bc service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:55.107218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 713/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:55.917008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23addf3c-5702-44d6-9081-7ee36d329db9 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:55.917528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23addf3c-5702-44d6-9081-7ee36d329db9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:55.917528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23addf3c-5702-44d6-9081-7ee36d329db9 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:55.918817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:55.923837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa296-a124-4eda-926e-4997c89605e3 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:55.924266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa296-a124-4eda-926e-4997c89605e3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:55.924372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa296-a124-4eda-926e-4997c89605e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:56.001691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f4bfa296-a124-4eda-926e-4997c89605e3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:56.002893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f4bfa296-a124-4eda-926e-4997c89605e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:56.042749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:56.096520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:56.247372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23addf3c-5702-44d6-9081-7ee36d329db9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:56.248988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-23addf3c-5702-44d6-9081-7ee36d329db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:56.394642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23addf3c-5702-44d6-9081-7ee36d329db9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:56.447383 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:56.505392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7be7e-1eba-490f-9413-25cb1e9f9ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:56.505912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7be7e-1eba-490f-9413-25cb1e9f9ab7 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:56.506193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7be7e-1eba-490f-9413-25cb1e9f9ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:56.506461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7be7e-1eba-490f-9413-25cb1e9f9ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:56.508035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3de7be7e-1eba-490f-9413-25cb1e9f9ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:56.595836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7be7e-1eba-490f-9413-25cb1e9f9ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:56.598345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7be7e-1eba-490f-9413-25cb1e9f9ab7 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:56.615953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 723/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:57.423052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732a35f-24aa-487a-9ab2-7314a2527dac None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:57.423630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732a35f-24aa-487a-9ab2-7314a2527dac None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:57.423630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732a35f-24aa-487a-9ab2-7314a2527dac None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:57.424995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:57.430414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044481-7ac0-4a04-ab8d-53185e6e52c6 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:57.430848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044481-7ac0-4a04-ab8d-53185e6e52c6 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:57.430946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044481-7ac0-4a04-ab8d-53185e6e52c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:57.509220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-89044481-7ac0-4a04-ab8d-53185e6e52c6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:23:57.510456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-89044481-7ac0-4a04-ab8d-53185e6e52c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:57.512567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:57.609221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:23:57.761626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732a35f-24aa-487a-9ab2-7314a2527dac None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:23:57.763132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c732a35f-24aa-487a-9ab2-7314a2527dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:57.906640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732a35f-24aa-487a-9ab2-7314a2527dac None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:23:57.933125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:58.020324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2f50a-5c9a-4080-84af-6fc140f1ddb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:23:58.020880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2f50a-5c9a-4080-84af-6fc140f1ddb0 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:58.021154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2f50a-5c9a-4080-84af-6fc140f1ddb0 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:58.021422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2f50a-5c9a-4080-84af-6fc140f1ddb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:58.023346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8fc2f50a-5c9a-4080-84af-6fc140f1ddb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:23:58.110486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2f50a-5c9a-4080-84af-6fc140f1ddb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:23:58.112074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2f50a-5c9a-4080-84af-6fc140f1ddb0 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:23:58.129752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 716/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:59.950515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac61b44-3b79-4a06-8d2d-df04a9305744 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:59.951071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac61b44-3b79-4a06-8d2d-df04a9305744 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:59.951071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac61b44-3b79-4a06-8d2d-df04a9305744 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:59.952423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:23:59.958234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe2762-d833-4e1c-bd79-1a0ce9fdea70 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:23:59.958671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe2762-d833-4e1c-bd79-1a0ce9fdea70 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:23:59.958778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe2762-d833-4e1c-bd79-1a0ce9fdea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:23:59.999250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:00.024446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-93fe2762-d833-4e1c-bd79-1a0ce9fdea70 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:00.025640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-93fe2762-d833-4e1c-bd79-1a0ce9fdea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:00.119881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:24:00.403682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac61b44-3b79-4a06-8d2d-df04a9305744 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:00.405244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3ac61b44-3b79-4a06-8d2d-df04a9305744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:00.505770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac61b44-3b79-4a06-8d2d-df04a9305744 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:00.537421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:00.577781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b55f3b-64f1-4d17-938c-76bfbfaccd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:00.578363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55f3b-64f1-4d17-938c-76bfbfaccd90 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:00.578638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55f3b-64f1-4d17-938c-76bfbfaccd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:00.578907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55f3b-64f1-4d17-938c-76bfbfaccd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:00.580501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-44b55f3b-64f1-4d17-938c-76bfbfaccd90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:00.685874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b55f3b-64f1-4d17-938c-76bfbfaccd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:00.687291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b55f3b-64f1-4d17-938c-76bfbfaccd90 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:00.705226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 726/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:02.724256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41cc88-2661-40c4-925d-918672d53476 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:02.724824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41cc88-2661-40c4-925d-918672d53476 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:02.724824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41cc88-2661-40c4-925d-918672d53476 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:02.726152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:02.731431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37245a-bf64-4fbd-a149-87c36ecc30dd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:02.731836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37245a-bf64-4fbd-a149-87c36ecc30dd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:02.731985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37245a-bf64-4fbd-a149-87c36ecc30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:02.796573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-de37245a-bf64-4fbd-a149-87c36ecc30dd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:02.797713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-de37245a-bf64-4fbd-a149-87c36ecc30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:02.810152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:02.896905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:03.178901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41cc88-2661-40c4-925d-918672d53476 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:03.180467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ec41cc88-2661-40c4-925d-918672d53476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:03.282216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41cc88-2661-40c4-925d-918672d53476 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:03.294806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:03.355343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153403-e800-4c88-b35c-153356383bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:03.355938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153403-e800-4c88-b35c-153356383bfe service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:03.356213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153403-e800-4c88-b35c-153356383bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:03.356510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153403-e800-4c88-b35c-153356383bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:03.358087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a5153403-e800-4c88-b35c-153356383bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:03.465445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153403-e800-4c88-b35c-153356383bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:03.466883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153403-e800-4c88-b35c-153356383bfe service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:03.485403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 719/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:05.696917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5907-0604-4f38-983d-b2dcc5447c92 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:05.697451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5907-0604-4f38-983d-b2dcc5447c92 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:05.697598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5907-0604-4f38-983d-b2dcc5447c92 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:05.699714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:05.705410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061cd0-9208-434b-bee0-476cd35b373e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:05.705857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061cd0-9208-434b-bee0-476cd35b373e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:05.705966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061cd0-9208-434b-bee0-476cd35b373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:05.753029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:05.772364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-08061cd0-9208-434b-bee0-476cd35b373e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:05.773805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-08061cd0-9208-434b-bee0-476cd35b373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:05.870628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:06.153530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d5907-0604-4f38-983d-b2dcc5447c92 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:06.155081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d84d5907-0604-4f38-983d-b2dcc5447c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:06.258621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d5907-0604-4f38-983d-b2dcc5447c92 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:06.297692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:06.332147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c1be1-2dd4-4967-bea5-254d02ccd9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:06.332779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c1be1-2dd4-4967-bea5-254d02ccd9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:06.333059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c1be1-2dd4-4967-bea5-254d02ccd9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:06.333331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c1be1-2dd4-4967-bea5-254d02ccd9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:06.334913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-062c1be1-2dd4-4967-bea5-254d02ccd9c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:06.440826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c1be1-2dd4-4967-bea5-254d02ccd9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:06.442374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c1be1-2dd4-4967-bea5-254d02ccd9c5 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:06.459854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 729/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:08.454587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baefebd-a8ef-48d6-8c1e-1759dcd1932f None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:08.455123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baefebd-a8ef-48d6-8c1e-1759dcd1932f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:08.455123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baefebd-a8ef-48d6-8c1e-1759dcd1932f None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:08.456486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:08.462220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b62f4-c971-4154-abb4-bceabff7add2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:08.462638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b62f4-c971-4154-abb4-bceabff7add2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:08.462761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b62f4-c971-4154-abb4-bceabff7add2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:08.528537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-641b62f4-c971-4154-abb4-bceabff7add2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:08.529756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-641b62f4-c971-4154-abb4-bceabff7add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:08.551330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:08.627324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:08.911771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baefebd-a8ef-48d6-8c1e-1759dcd1932f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:08.913350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1baefebd-a8ef-48d6-8c1e-1759dcd1932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:09.016280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baefebd-a8ef-48d6-8c1e-1759dcd1932f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:09.036118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:09.089291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff536b-f9f4-483b-bf11-d1ca8e835c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:09.089895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff536b-f9f4-483b-bf11-d1ca8e835c6c service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:09.090192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff536b-f9f4-483b-bf11-d1ca8e835c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:09.090444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff536b-f9f4-483b-bf11-d1ca8e835c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:09.092048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-91ff536b-f9f4-483b-bf11-d1ca8e835c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:09.198775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff536b-f9f4-483b-bf11-d1ca8e835c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:09.200211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff536b-f9f4-483b-bf11-d1ca8e835c6c service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:09.218246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 722/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:11.145477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba113e-2d75-4e30-9f58-cf6fc86e768c None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:11.146040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba113e-2d75-4e30-9f58-cf6fc86e768c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:11.146040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba113e-2d75-4e30-9f58-cf6fc86e768c None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:11.147354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:11.152742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1da2-0be4-4603-b33b-ef539cb18695 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:11.153177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1da2-0be4-4603-b33b-ef539cb18695 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:11.153276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1da2-0be4-4603-b33b-ef539cb18695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:11.216026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:11.218690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-41ae1da2-0be4-4603-b33b-ef539cb18695 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:11.220631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-41ae1da2-0be4-4603-b33b-ef539cb18695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:11.315020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:11.600926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba113e-2d75-4e30-9f58-cf6fc86e768c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:11.602498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-91ba113e-2d75-4e30-9f58-cf6fc86e768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:11.710640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba113e-2d75-4e30-9f58-cf6fc86e768c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:11.763240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:11.788092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ea22-30f3-4871-99a5-00b8a50ba7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:11.788656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ea22-30f3-4871-99a5-00b8a50ba7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:11.788937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ea22-30f3-4871-99a5-00b8a50ba7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:11.789209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ea22-30f3-4871-99a5-00b8a50ba7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:11.790794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4e22ea22-30f3-4871-99a5-00b8a50ba7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:11.898115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ea22-30f3-4871-99a5-00b8a50ba7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:11.899550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ea22-30f3-4871-99a5-00b8a50ba7d1 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:11.917270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 732/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:13.965844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561625-122c-4bd2-b6fd-35fbe5005903 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:13.966406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561625-122c-4bd2-b6fd-35fbe5005903 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:13.966406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561625-122c-4bd2-b6fd-35fbe5005903 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:13.967741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:13.973795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ff2be-21b1-46be-831e-24ee5fb0d75a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:13.974219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ff2be-21b1-46be-831e-24ee5fb0d75a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:13.974328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ff2be-21b1-46be-831e-24ee5fb0d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:14.039687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2c1ff2be-21b1-46be-831e-24ee5fb0d75a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:14.040927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2c1ff2be-21b1-46be-831e-24ee5fb0d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:14.070067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:14.136787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:14.419471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45561625-122c-4bd2-b6fd-35fbe5005903 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:14.421034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-45561625-122c-4bd2-b6fd-35fbe5005903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:14.523055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45561625-122c-4bd2-b6fd-35fbe5005903 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:14.551346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:14.596144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc8d64-0ef0-46ab-9715-8b8461015ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:14.596799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc8d64-0ef0-46ab-9715-8b8461015ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:14.597076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc8d64-0ef0-46ab-9715-8b8461015ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:14.597346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc8d64-0ef0-46ab-9715-8b8461015ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:14.599795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7ccc8d64-0ef0-46ab-9715-8b8461015ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:14.704710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc8d64-0ef0-46ab-9715-8b8461015ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:14.706129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc8d64-0ef0-46ab-9715-8b8461015ce4 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:14.724582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 725/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:16.685194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96db56-3163-4925-858e-9949627ddf7e None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:16.685732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96db56-3163-4925-858e-9949627ddf7e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:16.685732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96db56-3163-4925-858e-9949627ddf7e None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:16.687088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:16.693009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2bbee-9c27-483c-ab2b-0f4e46630222 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:16.693422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2bbee-9c27-483c-ab2b-0f4e46630222 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:16.693562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2bbee-9c27-483c-ab2b-0f4e46630222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:16.761366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-32c2bbee-9c27-483c-ab2b-0f4e46630222 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:16.762574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-32c2bbee-9c27-483c-ab2b-0f4e46630222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:16.770891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:16.867622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:17.151910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96db56-3163-4925-858e-9949627ddf7e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:17.153485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9b96db56-3163-4925-858e-9949627ddf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:17.255637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96db56-3163-4925-858e-9949627ddf7e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:17.312011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:17.331100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf68ca-dea5-439f-ae7d-9d85ed1ec1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:17.331707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf68ca-dea5-439f-ae7d-9d85ed1ec1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:17.331986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf68ca-dea5-439f-ae7d-9d85ed1ec1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:17.332286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf68ca-dea5-439f-ae7d-9d85ed1ec1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:17.333955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-89cf68ca-dea5-439f-ae7d-9d85ed1ec1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:17.442228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf68ca-dea5-439f-ae7d-9d85ed1ec1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:17.443666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf68ca-dea5-439f-ae7d-9d85ed1ec1d2 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:17.461103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 735/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:19.415566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bba957-a94b-4d5e-91fb-980be1f730ad None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:19.416132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bba957-a94b-4d5e-91fb-980be1f730ad None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:19.416132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bba957-a94b-4d5e-91fb-980be1f730ad None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:19.417509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:19.422586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aab97-99ec-497f-942b-8bc3bfbd405b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:19.423009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aab97-99ec-497f-942b-8bc3bfbd405b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:19.423124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aab97-99ec-497f-942b-8bc3bfbd405b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:19.489617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6f9aab97-99ec-497f-942b-8bc3bfbd405b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:19.490811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6f9aab97-99ec-497f-942b-8bc3bfbd405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:19.528617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:19.589079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:19.867407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bba957-a94b-4d5e-91fb-980be1f730ad None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:19.868965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-10bba957-a94b-4d5e-91fb-980be1f730ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:19.969104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bba957-a94b-4d5e-91fb-980be1f730ad None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:20.009044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:20.044790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24b855-eb2b-48e2-988c-0175d0f95aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:20.045387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b855-eb2b-48e2-988c-0175d0f95aab service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:20.045661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b855-eb2b-48e2-988c-0175d0f95aab service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:20.045941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b855-eb2b-48e2-988c-0175d0f95aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:20.047497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4e24b855-eb2b-48e2-988c-0175d0f95aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:20.154243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24b855-eb2b-48e2-988c-0175d0f95aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:20.155599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24b855-eb2b-48e2-988c-0175d0f95aab service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:20.173145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 728/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:22.067205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90388d36-9e9f-49fb-9010-0660dc2dd756 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:22.067771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90388d36-9e9f-49fb-9010-0660dc2dd756 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:22.067771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90388d36-9e9f-49fb-9010-0660dc2dd756 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:22.069132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:22.074455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1076-6d4a-44c7-89ee-7ac2a780a2ac None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:22.074893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1076-6d4a-44c7-89ee-7ac2a780a2ac None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:22.075000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1076-6d4a-44c7-89ee-7ac2a780a2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:22.140994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c2bb1076-6d4a-44c7-89ee-7ac2a780a2ac None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:22.142111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c2bb1076-6d4a-44c7-89ee-7ac2a780a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:22.160277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:22.237467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:22.514230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90388d36-9e9f-49fb-9010-0660dc2dd756 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:22.515797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-90388d36-9e9f-49fb-9010-0660dc2dd756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:22.619627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90388d36-9e9f-49fb-9010-0660dc2dd756 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:22.685461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:22.693547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628c5ce-ce1b-4521-885c-d0b4d793cc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:22.694155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628c5ce-ce1b-4521-885c-d0b4d793cc45 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:22.694434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628c5ce-ce1b-4521-885c-d0b4d793cc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:22.694704 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628c5ce-ce1b-4521-885c-d0b4d793cc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:22.696310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e628c5ce-ce1b-4521-885c-d0b4d793cc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:22.803695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628c5ce-ce1b-4521-885c-d0b4d793cc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:22.805088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628c5ce-ce1b-4521-885c-d0b4d793cc45 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:22.823123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 738/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:24.736183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811617f0-b58f-4db5-a401-ea715538ed74 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:24.736815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811617f0-b58f-4db5-a401-ea715538ed74 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:24.736815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811617f0-b58f-4db5-a401-ea715538ed74 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:24.738080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:24.743994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c15a1-c0bd-4505-8872-a8b0a08fe066 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:24.744547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c15a1-c0bd-4505-8872-a8b0a08fe066 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:24.744547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c15a1-c0bd-4505-8872-a8b0a08fe066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:24.809701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6b0c15a1-c0bd-4505-8872-a8b0a08fe066 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:24.810823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6b0c15a1-c0bd-4505-8872-a8b0a08fe066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:24.858427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:24.905987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:25.186012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811617f0-b58f-4db5-a401-ea715538ed74 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:25.187543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-811617f0-b58f-4db5-a401-ea715538ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:25.289264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811617f0-b58f-4db5-a401-ea715538ed74 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:25.335188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:25.361930 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcb4be-f461-4beb-88c5-9993fbc6f1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:25.362607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb4be-f461-4beb-88c5-9993fbc6f1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:25.362913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb4be-f461-4beb-88c5-9993fbc6f1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:25.363210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb4be-f461-4beb-88c5-9993fbc6f1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:25.365492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5cdcb4be-f461-4beb-88c5-9993fbc6f1b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:25.470794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcb4be-f461-4beb-88c5-9993fbc6f1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:25.472205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcb4be-f461-4beb-88c5-9993fbc6f1b2 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:25.490958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 731/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:34.904270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=22 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:35.488096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=66 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:44.880240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faa01d-833f-40a2-ae78-edec0efbc4ce None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:44.880818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faa01d-833f-40a2-ae78-edec0efbc4ce None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:44.880818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faa01d-833f-40a2-ae78-edec0efbc4ce None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:44.882082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 740/1471] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:44.887245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949777-5366-4e52-a375-32acd8ac9f2b None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:44.887685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949777-5366-4e52-a375-32acd8ac9f2b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:44.887791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949777-5366-4e52-a375-32acd8ac9f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:44.952532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ae949777-5366-4e52-a375-32acd8ac9f2b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:44.953732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ae949777-5366-4e52-a375-32acd8ac9f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:45.047744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 732/1472] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:45.341518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de628c1-5b3c-4026-b68e-d1759b6351d1 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:45.341804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de628c1-5b3c-4026-b68e-d1759b6351d1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:45.342078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de628c1-5b3c-4026-b68e-d1759b6351d1 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:45.343394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 741/1473] 10.222.0.13 () {54 vars in 967 bytes} [Thu Sep 1 00:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:45.348100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9ee4-3275-4fe6-b240-fd0589999938 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:45.348375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9ee4-3275-4fe6-b240-fd0589999938 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:45.348673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9ee4-3275-4fe6-b240-fd0589999938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:45.422887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d72e9ee4-3275-4fe6-b240-fd0589999938 None None] MFA Rules not processed for user `fae893320e6c4ab996cdc2230172417e`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:45.424081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d72e9ee4-3275-4fe6-b240-fd0589999938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:45.445145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:45.501339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 733/1474] 10.222.0.13 () {58 vars in 1064 bytes} [Thu Sep 1 00:24:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:45.509378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de628c1-5b3c-4026-b68e-d1759b6351d1 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:45.510891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6de628c1-5b3c-4026-b68e-d1759b6351d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:45.613598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de628c1-5b3c-4026-b68e-d1759b6351d1 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:45.684598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095f94d-8842-4cd4-ae2c-04aa5a5f506b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:45.685203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095f94d-8842-4cd4-ae2c-04aa5a5f506b service glance] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:45.685478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095f94d-8842-4cd4-ae2c-04aa5a5f506b service glance] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:45.685748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095f94d-8842-4cd4-ae2c-04aa5a5f506b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:45.687338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d095f94d-8842-4cd4-ae2c-04aa5a5f506b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:45.740135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:45.794206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095f94d-8842-4cd4-ae2c-04aa5a5f506b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:45.795627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095f94d-8842-4cd4-ae2c-04aa5a5f506b service glance] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:45.814502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 742/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:47.802192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8ecc-6c86-4861-88d9-8e9bc10703e3 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:47.802741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8ecc-6c86-4861-88d9-8e9bc10703e3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:47.802741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8ecc-6c86-4861-88d9-8e9bc10703e3 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:47.803987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 734/1476] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:47.809318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43389af3-a61b-4669-a677-d02a23247e90 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:47.809745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43389af3-a61b-4669-a677-d02a23247e90 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:47.809851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43389af3-a61b-4669-a677-d02a23247e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:47.992950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-43389af3-a61b-4669-a677-d02a23247e90 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:47.994157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-43389af3-a61b-4669-a677-d02a23247e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:48.087777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 743/1477] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:48.383309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa8ecc-6c86-4861-88d9-8e9bc10703e3 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:48.384781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3afa8ecc-6c86-4861-88d9-8e9bc10703e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:48.630227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa8ecc-6c86-4861-88d9-8e9bc10703e3 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:48.678521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:48.721655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101d58-348f-4601-aa23-8668ed33e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:48.722249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101d58-348f-4601-aa23-8668ed33e4bc admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:48.722519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101d58-348f-4601-aa23-8668ed33e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:48.722784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101d58-348f-4601-aa23-8668ed33e4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:48.723407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101d58-348f-4601-aa23-8668ed33e4bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:48.725412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-56101d58-348f-4601-aa23-8668ed33e4bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:24:48.725412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:24:48.725412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:24:48.726538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101d58-348f-4601-aa23-8668ed33e4bc admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:48.744321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 735/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Sep 1 00:24:48 2022] GET /identity/v3/projects => generated 2553 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:24:50.649104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa778e40-c976-4684-beea-bface4015f70 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:50.649659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa778e40-c976-4684-beea-bface4015f70 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:50.649659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa778e40-c976-4684-beea-bface4015f70 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:50.650961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 744/1479] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:50.656055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf59ad-6420-4f67-9144-8cc419634e9a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:50.656478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf59ad-6420-4f67-9144-8cc419634e9a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:50.656680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf59ad-6420-4f67-9144-8cc419634e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:50.721446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-80cf59ad-6420-4f67-9144-8cc419634e9a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:50.722647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-80cf59ad-6420-4f67-9144-8cc419634e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:50.827991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 736/1480] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:51.121205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa778e40-c976-4684-beea-bface4015f70 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:51.122797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fa778e40-c976-4684-beea-bface4015f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:51.133227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:51.267725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa778e40-c976-4684-beea-bface4015f70 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:51.345544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:51.377960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ca43-93e3-46ff-9ea1-790ac6384ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:51.378501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca43-93e3-46ff-9ea1-790ac6384ce1 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:51.378778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca43-93e3-46ff-9ea1-790ac6384ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:51.379047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca43-93e3-46ff-9ea1-790ac6384ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:51.381214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6941ca43-93e3-46ff-9ea1-790ac6384ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:51.467455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ca43-93e3-46ff-9ea1-790ac6384ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:51.469076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ca43-93e3-46ff-9ea1-790ac6384ce1 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:51.487192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 745/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:53.541713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dec8-bff6-4595-b610-8e69c22b3713 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:53.542158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dec8-bff6-4595-b610-8e69c22b3713 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:53.542252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dec8-bff6-4595-b610-8e69c22b3713 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:53.543591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 737/1482] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:53.548721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bdabd-f863-4d08-adaa-d32bdb01b7e9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:53.549139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bdabd-f863-4d08-adaa-d32bdb01b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:53.549295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bdabd-f863-4d08-adaa-d32bdb01b7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:53.612935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-889bdabd-f863-4d08-adaa-d32bdb01b7e9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:53.614136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-889bdabd-f863-4d08-adaa-d32bdb01b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:53.658866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:53.709492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 746/1483] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:53.991572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dec8-bff6-4595-b610-8e69c22b3713 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:53.993142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7b39dec8-bff6-4595-b610-8e69c22b3713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:54.015964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:54.096183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dec8-bff6-4595-b610-8e69c22b3713 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:54.171212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca7a3-3975-48ac-abbb-8b51a69c9681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:54.172215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca7a3-3975-48ac-abbb-8b51a69c9681 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:54.172300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca7a3-3975-48ac-abbb-8b51a69c9681 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:54.172642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca7a3-3975-48ac-abbb-8b51a69c9681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:54.174309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-51eca7a3-3975-48ac-abbb-8b51a69c9681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:54.248740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:54.285495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eca7a3-3975-48ac-abbb-8b51a69c9681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:54.286935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eca7a3-3975-48ac-abbb-8b51a69c9681 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:54.305029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 738/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:56.260037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc46e-e7de-42f2-97eb-daddf59a1235 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:56.260649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc46e-e7de-42f2-97eb-daddf59a1235 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:56.260649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc46e-e7de-42f2-97eb-daddf59a1235 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:56.261955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 747/1485] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:56.267058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11ecf4-7426-470e-952e-e096b454eef4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:56.267518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11ecf4-7426-470e-952e-e096b454eef4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:56.267647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11ecf4-7426-470e-952e-e096b454eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:56.333789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0d11ecf4-7426-470e-952e-e096b454eef4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:56.334982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0d11ecf4-7426-470e-952e-e096b454eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:56.428773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 739/1486] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:24:56.713793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc46e-e7de-42f2-97eb-daddf59a1235 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:56.715324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-802cc46e-e7de-42f2-97eb-daddf59a1235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:56.816346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc46e-e7de-42f2-97eb-daddf59a1235 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:56.886897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:56.888572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e3050-96a5-43e5-81e1-6a03ab348585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:56.889315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3050-96a5-43e5-81e1-6a03ab348585 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:56.889597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3050-96a5-43e5-81e1-6a03ab348585 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:56.890060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3050-96a5-43e5-81e1-6a03ab348585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:56.892039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c64e3050-96a5-43e5-81e1-6a03ab348585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:56.998750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e3050-96a5-43e5-81e1-6a03ab348585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:57.000187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e3050-96a5-43e5-81e1-6a03ab348585 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:57.019201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 748/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:24:59.071928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4adff7-e159-4525-b596-3777ff98f7f5 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:59.072530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4adff7-e159-4525-b596-3777ff98f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:59.072530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4adff7-e159-4525-b596-3777ff98f7f5 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:59.073849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 740/1488] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:24:59.079004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7839a-4d3d-4c42-8990-cda0f25e406e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:59.079407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7839a-4d3d-4c42-8990-cda0f25e406e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:59.079551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7839a-4d3d-4c42-8990-cda0f25e406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:59.144238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-94a7839a-4d3d-4c42-8990-cda0f25e406e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:24:59.145503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-94a7839a-4d3d-4c42-8990-cda0f25e406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:59.197169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:59.241455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 749/1489] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:24:59.530846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4adff7-e159-4525-b596-3777ff98f7f5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:24:59.532373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9d4adff7-e159-4525-b596-3777ff98f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:59.568209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:59.637123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4adff7-e159-4525-b596-3777ff98f7f5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:24:59.709014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdfbbf-6e55-4b87-b26a-82727e8d52ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:24:59.709606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdfbbf-6e55-4b87-b26a-82727e8d52ee service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:24:59.709877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdfbbf-6e55-4b87-b26a-82727e8d52ee service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:24:59.710167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdfbbf-6e55-4b87-b26a-82727e8d52ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:24:59.711723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-15bdfbbf-6e55-4b87-b26a-82727e8d52ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:24:59.788757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:59.817071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdfbbf-6e55-4b87-b26a-82727e8d52ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:24:59.818483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdfbbf-6e55-4b87-b26a-82727e8d52ee service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:24:59.835664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 741/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:25:01.922077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636adb75-f09a-4b11-93e5-3f395bc5f0e8 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:25:01.922613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636adb75-f09a-4b11-93e5-3f395bc5f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:25:01.922613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636adb75-f09a-4b11-93e5-3f395bc5f0e8 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:25:01.923870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 750/1491] 10.222.0.13 () {54 vars in 927 bytes} [Thu Sep 1 00:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:25:01.929671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01e322-a654-4740-93be-a3ab265ebd0d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:25:01.930052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01e322-a654-4740-93be-a3ab265ebd0d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:25:01.930246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01e322-a654-4740-93be-a3ab265ebd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:25:01.997392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ba01e322-a654-4740-93be-a3ab265ebd0d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:25:01.998602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ba01e322-a654-4740-93be-a3ab265ebd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:25:02.092488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 742/1492] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Sep 1 00:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:25:02.383082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636adb75-f09a-4b11-93e5-3f395bc5f0e8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:25:02.384646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-636adb75-f09a-4b11-93e5-3f395bc5f0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:25:02.485696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636adb75-f09a-4b11-93e5-3f395bc5f0e8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:25:02.558508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cc246-cb6c-4471-924e-fcf02b26ded2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:25:02.559049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cc246-cb6c-4471-924e-fcf02b26ded2 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:25:02.559327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cc246-cb6c-4471-924e-fcf02b26ded2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:25:02.559599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cc246-cb6c-4471-924e-fcf02b26ded2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:25:02.561226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-003cc246-cb6c-4471-924e-fcf02b26ded2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:25:02.570300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:25:02.674880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cc246-cb6c-4471-924e-fcf02b26ded2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:25:02.676971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cc246-cb6c-4471-924e-fcf02b26ded2 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:25:02.695136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 751/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:25:12.090695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=82 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:25:12.692298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=50 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:19.567842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:19.568352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:19.568515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:19.643027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:26:19.644225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:19.740168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 743/1494] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:26:19.751626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120588dc-354f-43a5-bbbe-838bd26a7d1e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:19.752133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120588dc-354f-43a5-bbbe-838bd26a7d1e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:19.752240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120588dc-354f-43a5-bbbe-838bd26a7d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:19.829129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-120588dc-354f-43a5-bbbe-838bd26a7d1e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:26:19.830243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-120588dc-354f-43a5-bbbe-838bd26a7d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:19.924475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 752/1495] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:26:19.929614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:19.930814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:19.942598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dcaa5-bead-4e2c-82b7-c97d505e4be8 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:20.003740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:20.038176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:20.038784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:20.039064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:20.039337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:20.039980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:26:20.040279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:20.041330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:20.041330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:26:20.041330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:26:20.042251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:20.054724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 744/1496] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:26:20.063102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120588dc-354f-43a5-bbbe-838bd26a7d1e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:20.072375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120588dc-354f-43a5-bbbe-838bd26a7d1e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:20.134337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:20.168519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:20.169125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:20.169401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:20.169676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:20.170308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:20.172043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING py.warnings [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:20.172043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: warnings.warn(msg) Sep 01 00:26:20.172043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: Sep 01 00:26:20.173256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:20.228763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 753/1497] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:26:20 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:26:20.233046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:20.234598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:20.267387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384b58e-3b08-43d9-a71a-8f5fb5027377 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:20.360230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:20.360865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:20.361138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:20.361403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:20.362040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:20.363216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:20.363216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:26:20.363216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:26:20.364504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:20.407367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 745/1498] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:26:20 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:26:20.412324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:20.413859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:20.474608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6ab6d-40ee-4b82-8fcc-b45c36b8b5a2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:20.556938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:20.568286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:20.568918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:20.569195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:20.569465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:20.570099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:20.571119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING py.warnings [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:20.571119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: warnings.warn(msg) Sep 01 00:26:20.571119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: Sep 01 00:26:20.571997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:20.584610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 754/1499] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:26:20.588679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:20.590188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:20.601706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccaa54-2fe4-494e-93f6-9b94a48766d9 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:20.626974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:20.696273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ab313-4340-48f6-b509-29fec7123358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:20.696917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab313-4340-48f6-b509-29fec7123358 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:20.697192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab313-4340-48f6-b509-29fec7123358 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:20.697460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab313-4340-48f6-b509-29fec7123358 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:20.698091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ab313-4340-48f6-b509-29fec7123358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:20.699111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-3d9ab313-4340-48f6-b509-29fec7123358 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:20.699111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:26:20.699111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:26:20.699995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ab313-4340-48f6-b509-29fec7123358 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:20.712051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 746/1500] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:26:20.716291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:20.717855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:20.751766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aae01-b3a4-4473-b4e8-9c3c6c0ae27b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:20.844634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6417c9f-02b7-4881-ba45-654987c1ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:20.845282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417c9f-02b7-4881-ba45-654987c1ba94 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:20.845560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417c9f-02b7-4881-ba45-654987c1ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:20.845831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417c9f-02b7-4881-ba45-654987c1ba94 admin admin] PATH_INFO: `/v3/projects/99230c287c274272b92a9652cf4889e8/users/93f9558310284fabbbcc7678cae84ca9/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:20.868872 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6417c9f-02b7-4881-ba45-654987c1ba94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99230c287c274272b92a9652cf4889e8, user_id=93f9558310284fabbbcc7678cae84ca9, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:20.869903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING py.warnings [None req-c6417c9f-02b7-4881-ba45-654987c1ba94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:20.869903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: warnings.warn(msg) Sep 01 00:26:20.869903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: Sep 01 00:26:20.871854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6417c9f-02b7-4881-ba45-654987c1ba94 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:20.895567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 755/1501] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:26:20 2022] PUT /identity/v3/projects/99230c287c274272b92a9652cf4889e8/users/93f9558310284fabbbcc7678cae84ca9/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:26:20.907494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a059e9-af7a-4eed-8d63-6998058a28c7 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:20.907854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a059e9-af7a-4eed-8d63-6998058a28c7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:20.908195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a059e9-af7a-4eed-8d63-6998058a28c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:20.965368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-10a059e9-af7a-4eed-8d63-6998058a28c7 None None] MFA Rules not processed for user `93f9558310284fabbbcc7678cae84ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:26:20.966506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-10a059e9-af7a-4eed-8d63-6998058a28c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:21.051213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 747/1502] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:26:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:26:21.064665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d4bcb-97f6-466c-948e-588cd9524ae9 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:21.064946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d4bcb-97f6-466c-948e-588cd9524ae9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:21.065220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d4bcb-97f6-466c-948e-588cd9524ae9 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:21.066542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 756/1503] 10.222.0.13 () {54 vars in 964 bytes} [Thu Sep 1 00:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:26:21.071098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48405-fb58-4ffa-b219-360ce3e5c63e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:21.071383 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48405-fb58-4ffa-b219-360ce3e5c63e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:21.071654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48405-fb58-4ffa-b219-360ce3e5c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:21.103149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:21.146623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-28a48405-fb58-4ffa-b219-360ce3e5c63e None None] MFA Rules not processed for user `b5a31dd48b6b4377a0eb375502344dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:26:21.147826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-28a48405-fb58-4ffa-b219-360ce3e5c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:21.227710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 748/1504] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Sep 1 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:26:21.237219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d4bcb-97f6-466c-948e-588cd9524ae9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:21.238902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3e2d4bcb-97f6-466c-948e-588cd9524ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:21.287797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:21.345534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d4bcb-97f6-466c-948e-588cd9524ae9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:21.417183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:21.417785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:21.418064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:21.418336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:21.419918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:21.516139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:21.517544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:21.521701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:21.536581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 757/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:26:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:26:21.581029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80348c22-a664-401e-a8e1-4ca1ea804b4e None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:21.581319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80348c22-a664-401e-a8e1-4ca1ea804b4e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:21.581622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80348c22-a664-401e-a8e1-4ca1ea804b4e None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:21.583491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 749/1506] 10.222.0.13 () {52 vars in 830 bytes} [Thu Sep 1 00:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:26:21.586963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:21.588223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:21.685641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9e85-d89c-41a4-8c5f-a894e2580d9d service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:21.778261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:21.778876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:21.779077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:21.779347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] PATH_INFO: `/v3/users/93f9558310284fabbbcc7678cae84ca9` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:21.791220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f9558310284fabbbcc7678cae84ca9)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:21.792244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING py.warnings [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:21.792244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: warnings.warn(msg) Sep 01 00:26:21.792244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: Sep 01 00:26:21.793548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:21.803414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:21.858522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f9558310284fabbbcc7678cae84ca9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:21.872644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f9558310284fabbbcc7678cae84ca9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:21.873191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f9558310284fabbbcc7678cae84ca9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:21.884553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f9558310284fabbbcc7678cae84ca9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:21.909240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f9558310284fabbbcc7678cae84ca9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:21.914949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 758/1507] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:26:21 2022] DELETE /identity/v3/users/93f9558310284fabbbcc7678cae84ca9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:26:21.919292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:21.919750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:21.919856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:21.976893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:26:21.978401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:22.053081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:22.065754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 750/1508] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:26:22.076535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:22.077783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:22.174151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76e41-67e7-42d5-a213-740d3393e3c9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:22.228715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:22.250040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dde77d-17f4-402f-a806-14e69c88f1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:22.250655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dde77d-17f4-402f-a806-14e69c88f1bd service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:22.250937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dde77d-17f4-402f-a806-14e69c88f1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:22.251209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dde77d-17f4-402f-a806-14e69c88f1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:22.252822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d1dde77d-17f4-402f-a806-14e69c88f1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:22.362006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dde77d-17f4-402f-a806-14e69c88f1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:22.363450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dde77d-17f4-402f-a806-14e69c88f1bd service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:22.381959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 759/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:26:22.703937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:26:22.705214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:26:22.717301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc5b3-dad1-4db6-a609-b8cc7dea27a4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:26:22.813676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:26:22.814300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:26:22.814575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:26:22.814836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] PATH_INFO: `/v3/projects/99230c287c274272b92a9652cf4889e8` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:26:22.825195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99230c287c274272b92a9652cf4889e8)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:26:22.826220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:26:22.826220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:26:22.826220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:26:22.827409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:26:22.884833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99230c287c274272b92a9652cf4889e8', 'request_id': 'req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:22.897476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99230c287c274272b92a9652cf4889e8', 'request_id': 'req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:22.903393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99230c287c274272b92a9652cf4889e8', 'request_id': 'req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:22.929180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] The token cache is being invalidate because project 99230c287c274272b92a9652cf4889e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:26:22.929789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:22.929889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14e113e7-4ff9-46fd-9ed4-bf3fa847ab5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:26:22.931246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 751/1510] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:26:22 2022] DELETE /identity/v3/projects/99230c287c274272b92a9652cf4889e8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:26:32.379237 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=62 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:26:32.927189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:27:51.886344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67057714-a638-4e3e-840a-d91bfcf3c9a4 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:51.886916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67057714-a638-4e3e-840a-d91bfcf3c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:51.886916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67057714-a638-4e3e-840a-d91bfcf3c9a4 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:51.888140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:27:51.893351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8696-5715-412f-9d3a-54357c29f07f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:51.893810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8696-5715-412f-9d3a-54357c29f07f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:51.894455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8696-5715-412f-9d3a-54357c29f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:51.978016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-602c8696-5715-412f-9d3a-54357c29f07f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:27:51.979481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-602c8696-5715-412f-9d3a-54357c29f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:27:52.080426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:27:52.238992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67057714-a638-4e3e-840a-d91bfcf3c9a4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:27:52.241096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-67057714-a638-4e3e-840a-d91bfcf3c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:27:52.356216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67057714-a638-4e3e-840a-d91bfcf3c9a4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:27:52.361630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4c05-5253-4c16-adf5-a4a2eb0d7bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:27:52.362227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4c05-5253-4c16-adf5-a4a2eb0d7bbe service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:52.362506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4c05-5253-4c16-adf5-a4a2eb0d7bbe service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:52.362807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4c05-5253-4c16-adf5-a4a2eb0d7bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:52.370662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4c05-5253-4c16-adf5-a4a2eb0d7bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:27:52.372246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4c05-5253-4c16-adf5-a4a2eb0d7bbe service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:27:52.382209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 761/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:27:53.218126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c2cd-8189-40e7-8da1-020b27e051cf None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:53.218687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c2cd-8189-40e7-8da1-020b27e051cf None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:53.218687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c2cd-8189-40e7-8da1-020b27e051cf None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:53.220013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:27:53.225078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d005eb-9fc7-4b43-be8f-5d338fe9ff39 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:53.225495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d005eb-9fc7-4b43-be8f-5d338fe9ff39 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:53.225601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d005eb-9fc7-4b43-be8f-5d338fe9ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:53.244951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d0d005eb-9fc7-4b43-be8f-5d338fe9ff39 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:27:53.246137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d0d005eb-9fc7-4b43-be8f-5d338fe9ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:27:53.255181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:27:53.408052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c2cd-8189-40e7-8da1-020b27e051cf None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:27:53.421980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c2cd-8189-40e7-8da1-020b27e051cf None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:27:53.427780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bda87-bd6d-42e9-901a-e1a38243f355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:27:53.428361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bda87-bd6d-42e9-901a-e1a38243f355 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:53.428665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bda87-bd6d-42e9-901a-e1a38243f355 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:53.428932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bda87-bd6d-42e9-901a-e1a38243f355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:53.436749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bda87-bd6d-42e9-901a-e1a38243f355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:27:53.438312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bda87-bd6d-42e9-901a-e1a38243f355 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:27:53.447946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 754/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:27:54.156937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f55f4-9005-4985-b103-ed27f40f372a None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:54.157184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f55f4-9005-4985-b103-ed27f40f372a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:54.157409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f55f4-9005-4985-b103-ed27f40f372a None None] PATH_INFO: `/v3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:54.158690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 763/1517] 10.222.0.44 () {54 vars in 925 bytes} [Thu Sep 1 00:27:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:27:54.164882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314326a-1402-490a-9e19-9c1abd95106c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:54.165276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314326a-1402-490a-9e19-9c1abd95106c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:54.165648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314326a-1402-490a-9e19-9c1abd95106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:54.226640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f314326a-1402-490a-9e19-9c1abd95106c None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:27:54.227836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f314326a-1402-490a-9e19-9c1abd95106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:27:54.244179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:27:54.299705 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 755/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Sep 1 00:27:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:27:58.064561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f1f94-fc8f-4055-b48b-1190631b6347 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:58.065050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f1f94-fc8f-4055-b48b-1190631b6347 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:58.065166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f1f94-fc8f-4055-b48b-1190631b6347 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:58.066409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 764/1519] 10.222.0.13 () {54 vars in 961 bytes} [Thu Sep 1 00:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:27:58.071615 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86233e59-14d5-4d8c-8884-839ff36a25b7 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:58.072046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86233e59-14d5-4d8c-8884-839ff36a25b7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:58.072153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86233e59-14d5-4d8c-8884-839ff36a25b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:58.091627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-86233e59-14d5-4d8c-8884-839ff36a25b7 None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:27:58.092839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-86233e59-14d5-4d8c-8884-839ff36a25b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:27:58.101814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 756/1520] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Sep 1 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:27:58.109356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f1f94-fc8f-4055-b48b-1190631b6347 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:27:58.122327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f1f94-fc8f-4055-b48b-1190631b6347 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:27:58.127159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed497b72-1909-4dbb-9d19-71bff6c7ab72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:27:58.127736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed497b72-1909-4dbb-9d19-71bff6c7ab72 service placement] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:27:58.128009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed497b72-1909-4dbb-9d19-71bff6c7ab72 service placement] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:27:58.128276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed497b72-1909-4dbb-9d19-71bff6c7ab72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:27:58.136938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed497b72-1909-4dbb-9d19-71bff6c7ab72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:27:58.138500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed497b72-1909-4dbb-9d19-71bff6c7ab72 service placement] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:27:58.148864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 765/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:27:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:28:04.680169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3a64-5eda-4a06-baf7-8c4c2bd2385f None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:04.680723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3a64-5eda-4a06-baf7-8c4c2bd2385f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:04.680723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3a64-5eda-4a06-baf7-8c4c2bd2385f None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:04.682002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:28:04.686870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4d9a-c64a-4eb6-87b6-76ff08e4500a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:04.687281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4d9a-c64a-4eb6-87b6-76ff08e4500a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:04.687396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4d9a-c64a-4eb6-87b6-76ff08e4500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:04.706892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0e9b4d9a-c64a-4eb6-87b6-76ff08e4500a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:28:04.708079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0e9b4d9a-c64a-4eb6-87b6-76ff08e4500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:04.715894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:28:04.869576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d3a64-5eda-4a06-baf7-8c4c2bd2385f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:28:04.884464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d3a64-5eda-4a06-baf7-8c4c2bd2385f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:28:04.890738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84a82a-4c55-4f00-bc5a-bb1c8a1406fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:28:04.891329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a82a-4c55-4f00-bc5a-bb1c8a1406fb service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:04.891607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a82a-4c55-4f00-bc5a-bb1c8a1406fb service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:04.891877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a82a-4c55-4f00-bc5a-bb1c8a1406fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:04.899952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84a82a-4c55-4f00-bc5a-bb1c8a1406fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:28:04.901549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84a82a-4c55-4f00-bc5a-bb1c8a1406fb service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:28:04.911272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 758/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:28:05.728430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a906-3929-4aba-9bb5-81ad36438713 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:05.729245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a906-3929-4aba-9bb5-81ad36438713 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:05.729245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a906-3929-4aba-9bb5-81ad36438713 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:05.730621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 00:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:28:05.735284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129c019-77a4-4bfe-bf1b-f49c4ef629be None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:05.735699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129c019-77a4-4bfe-bf1b-f49c4ef629be None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:05.735837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129c019-77a4-4bfe-bf1b-f49c4ef629be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:05.757242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5129c019-77a4-4bfe-bf1b-f49c4ef629be None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:28:05.758545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5129c019-77a4-4bfe-bf1b-f49c4ef629be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:05.766238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 00:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:28:05.919034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a906-3929-4aba-9bb5-81ad36438713 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:28:05.933112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a906-3929-4aba-9bb5-81ad36438713 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:28:05.938582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccea2c4-354a-4fc1-986c-57ae8873571a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:28:05.939170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccea2c4-354a-4fc1-986c-57ae8873571a service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:05.939447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccea2c4-354a-4fc1-986c-57ae8873571a service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:05.939718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccea2c4-354a-4fc1-986c-57ae8873571a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:05.948236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccea2c4-354a-4fc1-986c-57ae8873571a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:28:05.949855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccea2c4-354a-4fc1-986c-57ae8873571a service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:28:05.959640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 768/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:28:09.676772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1c456-70a0-43bc-83c4-33a7f92f041c None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:09.677323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1c456-70a0-43bc-83c4-33a7f92f041c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:09.677433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1c456-70a0-43bc-83c4-33a7f92f041c None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:09.678690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:28:09.683773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5349ec-f6bd-4714-af30-979618dfe60f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:09.684236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5349ec-f6bd-4714-af30-979618dfe60f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:09.684345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5349ec-f6bd-4714-af30-979618dfe60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:09.703140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0a5349ec-f6bd-4714-af30-979618dfe60f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:28:09.704314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0a5349ec-f6bd-4714-af30-979618dfe60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:09.712211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:28:09.996036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1c456-70a0-43bc-83c4-33a7f92f041c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:28:09.997773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7be1c456-70a0-43bc-83c4-33a7f92f041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:10.076761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1c456-70a0-43bc-83c4-33a7f92f041c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:28:10.080235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a74f46-06f8-4786-be15-89314ec390f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:28:10.080928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74f46-06f8-4786-be15-89314ec390f4 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:10.081202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74f46-06f8-4786-be15-89314ec390f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:10.081465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74f46-06f8-4786-be15-89314ec390f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:10.090726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a74f46-06f8-4786-be15-89314ec390f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:28:10.092144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a74f46-06f8-4786-be15-89314ec390f4 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:28:10.102010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 761/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:28:11.979867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc6a7-adcd-4612-8e3e-e78470f81685 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:11.980461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc6a7-adcd-4612-8e3e-e78470f81685 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:11.980461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc6a7-adcd-4612-8e3e-e78470f81685 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:11.981791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:28:11.987034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0db53-8d2b-42ec-883b-c441ae900eeb None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:11.987439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0db53-8d2b-42ec-883b-c441ae900eeb None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:11.987579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0db53-8d2b-42ec-883b-c441ae900eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:12.007684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-77e0db53-8d2b-42ec-883b-c441ae900eeb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:28:12.008920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-77e0db53-8d2b-42ec-883b-c441ae900eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:12.016745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:28:12.309885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc6a7-adcd-4612-8e3e-e78470f81685 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:28:12.320414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc6a7-adcd-4612-8e3e-e78470f81685 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:28:12.323810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162e3bf-c350-4862-b528-fc4514ebaeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:28:12.324406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162e3bf-c350-4862-b528-fc4514ebaeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:12.324695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162e3bf-c350-4862-b528-fc4514ebaeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:12.324962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162e3bf-c350-4862-b528-fc4514ebaeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:12.334159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162e3bf-c350-4862-b528-fc4514ebaeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:28:12.335616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162e3bf-c350-4862-b528-fc4514ebaeb9 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:28:12.344831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 771/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:28:15.651751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faa04f-006a-45e9-a1da-77f42fcf4028 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:15.652303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faa04f-006a-45e9-a1da-77f42fcf4028 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:15.652303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faa04f-006a-45e9-a1da-77f42fcf4028 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:15.653670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:28:15.658972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68b0c-b29a-4dce-bbe9-a27764a93675 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:15.659405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68b0c-b29a-4dce-bbe9-a27764a93675 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:15.659505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68b0c-b29a-4dce-bbe9-a27764a93675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:15.667027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=81 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:28:15.679929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fdb68b0c-b29a-4dce-bbe9-a27764a93675 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:28:15.681156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fdb68b0c-b29a-4dce-bbe9-a27764a93675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:15.688948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:28:16.231318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faa04f-006a-45e9-a1da-77f42fcf4028 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:28:16.233025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-52faa04f-006a-45e9-a1da-77f42fcf4028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:16.295911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:28:16.309277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faa04f-006a-45e9-a1da-77f42fcf4028 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:28:16.312825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760715-b0f7-418c-921a-8d6d06aac74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:28:16.313417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760715-b0f7-418c-921a-8d6d06aac74b service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:16.313688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760715-b0f7-418c-921a-8d6d06aac74b service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:16.313954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760715-b0f7-418c-921a-8d6d06aac74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:16.323109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760715-b0f7-418c-921a-8d6d06aac74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:28:16.324544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760715-b0f7-418c-921a-8d6d06aac74b service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:28:16.334481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 764/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:28:18.248228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aba7fa-2c3b-4bde-a4cb-57c1233e458d None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:18.250124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aba7fa-2c3b-4bde-a4cb-57c1233e458d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:18.250124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aba7fa-2c3b-4bde-a4cb-57c1233e458d None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:18.250325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 00:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:28:18.255984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e37e5-c0c1-42ad-a14d-24bf8483bb18 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:18.256466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e37e5-c0c1-42ad-a14d-24bf8483bb18 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:18.256579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e37e5-c0c1-42ad-a14d-24bf8483bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:18.275660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0b8e37e5-c0c1-42ad-a14d-24bf8483bb18 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:28:18.276886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0b8e37e5-c0c1-42ad-a14d-24bf8483bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:18.284690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 00:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:28:18.836598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aba7fa-2c3b-4bde-a4cb-57c1233e458d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:28:18.838329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-19aba7fa-2c3b-4bde-a4cb-57c1233e458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:28:18.851697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aba7fa-2c3b-4bde-a4cb-57c1233e458d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:28:18.855437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3011721-4137-474c-a144-b29330b77522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:28:18.856015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3011721-4137-474c-a144-b29330b77522 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:28:18.856288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3011721-4137-474c-a144-b29330b77522 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:28:18.856587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3011721-4137-474c-a144-b29330b77522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:28:18.865241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3011721-4137-474c-a144-b29330b77522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:28:18.866654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3011721-4137-474c-a144-b29330b77522 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:28:18.875753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 774/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:28:28.270772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=11 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:28:28.871742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=8 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:44.845223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8771-c382-40c1-be0f-302bb7e83574 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:44.846380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8771-c382-40c1-be0f-302bb7e83574 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:44.846380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8771-c382-40c1-be0f-302bb7e83574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:44.870783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-160e8771-c382-40c1-be0f-302bb7e83574 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:44.872406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-160e8771-c382-40c1-be0f-302bb7e83574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:44.883793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 766/1540] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:44.893344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f3d1-9a4f-40a9-a006-b2074f39c06b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:44.893956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f3d1-9a4f-40a9-a006-b2074f39c06b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:44.893956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f3d1-9a4f-40a9-a006-b2074f39c06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:44.922442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2b17f3d1-9a4f-40a9-a006-b2074f39c06b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:44.923641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2b17f3d1-9a4f-40a9-a006-b2074f39c06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:44.936670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 775/1541] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:44.941586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e8771-c382-40c1-be0f-302bb7e83574 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:44.959717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e8771-c382-40c1-be0f-302bb7e83574 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:44.964616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:44.965857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:44.966785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:44.967070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:44.967730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:44.968034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:44.969682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:44.988630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 767/1542] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:44.999177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f3d1-9a4f-40a9-a006-b2074f39c06b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.013667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f3d1-9a4f-40a9-a006-b2074f39c06b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.021008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.022154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.022429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.022692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.023432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.025366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.078105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 776/1543] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:44 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:45.082097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.094130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a864-7b2c-4a07-8a5f-7d311b195a84 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.190249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.190851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.191138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.191410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.192057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.194142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.222525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 768/1544] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:45.227403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.242809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506327ad-c714-40ea-8f73-3783751d3fd9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.253073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00d41a-88b9-4154-b5f9-52340a424b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.253705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00d41a-88b9-4154-b5f9-52340a424b34 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.253981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00d41a-88b9-4154-b5f9-52340a424b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.254250 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00d41a-88b9-4154-b5f9-52340a424b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.254892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00d41a-88b9-4154-b5f9-52340a424b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.256758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00d41a-88b9-4154-b5f9-52340a424b34 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.271041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 777/1545] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:45.272816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.288942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf255-91a7-44d3-be7f-a7a5c4dddbd8 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.295131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.295785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.295914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e993f4-f228-4013-b7a0-4e565526ebe9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.296102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.296244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e993f4-f228-4013-b7a0-4e565526ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.296344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.296476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e993f4-f228-4013-b7a0-4e565526ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.297001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.298660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.317119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 769/1546] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:45.322184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.333756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-28e993f4-f228-4013-b7a0-4e565526ebe9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.335148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-28e993f4-f228-4013-b7a0-4e565526ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.338655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7da1-0d5b-4de6-853b-9f1f3cfb6b38 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.351127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 778/1547] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:29:45.352010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e9c7-72c6-4951-bb26-5e070bc5bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.352523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0d1f7-89b2-4cc0-a5c6-b92dd572c9d9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.352716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e9c7-72c6-4951-bb26-5e070bc5bf0a admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.352827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0d1f7-89b2-4cc0-a5c6-b92dd572c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.353001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e9c7-72c6-4951-bb26-5e070bc5bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.353107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0d1f7-89b2-4cc0-a5c6-b92dd572c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.353321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e9c7-72c6-4951-bb26-5e070bc5bf0a admin admin] PATH_INFO: `/v3/projects/9885c6da9fd6420eb736de5d93193830/users/562fcce5b9be41908036832d4aed1dff/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.380294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e9c7-72c6-4951-bb26-5e070bc5bf0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9885c6da9fd6420eb736de5d93193830, user_id=562fcce5b9be41908036832d4aed1dff, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.381938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-ee88e9c7-72c6-4951-bb26-5e070bc5bf0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:29:45.381938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:29:45.381938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:29:45.383896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e9c7-72c6-4951-bb26-5e070bc5bf0a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.393534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5fd0d1f7-89b2-4cc0-a5c6-b92dd572c9d9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.394779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5fd0d1f7-89b2-4cc0-a5c6-b92dd572c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.407455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 770/1548] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:45 2022] PUT /identity/v3/projects/9885c6da9fd6420eb736de5d93193830/users/562fcce5b9be41908036832d4aed1dff/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:29:45.413401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 779/1549] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:45.413582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a542f7-ca0f-411c-b533-2c9ff1ad2eaf None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.413786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a542f7-ca0f-411c-b533-2c9ff1ad2eaf None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.414011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a542f7-ca0f-411c-b533-2c9ff1ad2eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.414709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b762b6-7d6d-43dc-8b3a-d27829a23700 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.414996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b762b6-7d6d-43dc-8b3a-d27829a23700 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.415269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b762b6-7d6d-43dc-8b3a-d27829a23700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.441417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c4a542f7-ca0f-411c-b533-2c9ff1ad2eaf None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.443136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c4a542f7-ca0f-411c-b533-2c9ff1ad2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.451933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-57b762b6-7d6d-43dc-8b3a-d27829a23700 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.453202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-57b762b6-7d6d-43dc-8b3a-d27829a23700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.560806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 771/1550] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:45.562168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.562454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.562728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.566378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 780/1551] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:45.567300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b762b6-7d6d-43dc-8b3a-d27829a23700 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.590283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.590516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b762b6-7d6d-43dc-8b3a-d27829a23700 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.591601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.610794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 772/1552] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:45.611531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.613094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.613730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.614008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.614524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.615282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:45.615563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.615759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.616636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING py.warnings [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:29:45.616636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: warnings.warn(msg) Sep 01 00:29:45.616636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: Sep 01 00:29:45.617520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.635298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 781/1553] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:45.636152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.658348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a6c1c-48d1-472a-9520-76277fc74179 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.677045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:45.681195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33815d3-fe84-46c0-8edf-d8edb846372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.681833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33815d3-fe84-46c0-8edf-d8edb846372b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.682113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33815d3-fe84-46c0-8edf-d8edb846372b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.682386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33815d3-fe84-46c0-8edf-d8edb846372b admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.683045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33815d3-fe84-46c0-8edf-d8edb846372b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:45.683348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33815d3-fe84-46c0-8edf-d8edb846372b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.685294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33815d3-fe84-46c0-8edf-d8edb846372b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.711989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 782/1554] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:45.711989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e3d2-ff56-4dc9-90c5-24c65b93a108 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.711989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e3d2-ff56-4dc9-90c5-24c65b93a108 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.711989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e3d2-ff56-4dc9-90c5-24c65b93a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.728363 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2e93-702b-4ebd-9a90-98152e8c6484 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.732560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908fc2-db72-45fd-8456-3f5eb2fffc17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.733172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908fc2-db72-45fd-8456-3f5eb2fffc17 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.733448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908fc2-db72-45fd-8456-3f5eb2fffc17 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.733719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908fc2-db72-45fd-8456-3f5eb2fffc17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.736542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4f82e3d2-ff56-4dc9-90c5-24c65b93a108 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.737732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4f82e3d2-ff56-4dc9-90c5-24c65b93a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.745236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec908fc2-db72-45fd-8456-3f5eb2fffc17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.746964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 783/1555] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:45.747095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec908fc2-db72-45fd-8456-3f5eb2fffc17 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.747827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e3d2-ff56-4dc9-90c5-24c65b93a108 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.757967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e3d2-ff56-4dc9-90c5-24c65b93a108 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.759942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 773/1556] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:45.761219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f305-679a-438f-aea6-ae0d8a5ded32 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.761504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f305-679a-438f-aea6-ae0d8a5ded32 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.762125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f305-679a-438f-aea6-ae0d8a5ded32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.763423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8ce48-65f1-474c-bae2-e72cb97d4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.764113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ce48-65f1-474c-bae2-e72cb97d4602 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.764489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ce48-65f1-474c-bae2-e72cb97d4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.764839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ce48-65f1-474c-bae2-e72cb97d4602 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.765530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8ce48-65f1-474c-bae2-e72cb97d4602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.767510 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8ce48-65f1-474c-bae2-e72cb97d4602 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.784070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-dda7f305-679a-438f-aea6-ae0d8a5ded32 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.785956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-dda7f305-679a-438f-aea6-ae0d8a5ded32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.804418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 774/1557] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:45.804637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 784/1558] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:45.804751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f305-679a-438f-aea6-ae0d8a5ded32 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:45.804836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cd619-235c-4bb5-8a86-beb4d0bd9513 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.804836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cd619-235c-4bb5-8a86-beb4d0bd9513 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.804836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cd619-235c-4bb5-8a86-beb4d0bd9513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.812740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f305-679a-438f-aea6-ae0d8a5ded32 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:45.822561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-375cd619-235c-4bb5-8a86-beb4d0bd9513 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.824263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-375cd619-235c-4bb5-8a86-beb4d0bd9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.884009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:45.886601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771f4be-8201-4e2f-aef1-93c1fd70bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:45.887384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771f4be-8201-4e2f-aef1-93c1fd70bc63 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.887606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771f4be-8201-4e2f-aef1-93c1fd70bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.887871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771f4be-8201-4e2f-aef1-93c1fd70bc63 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.888723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771f4be-8201-4e2f-aef1-93c1fd70bc63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:45.889707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-2771f4be-8201-4e2f-aef1-93c1fd70bc63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:29:45.889707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:29:45.889707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:29:45.890923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771f4be-8201-4e2f-aef1-93c1fd70bc63 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:45.907060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 785/1559] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:45.908237 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c066e-d730-4ddd-a922-d5dc68516704 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.908626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c066e-d730-4ddd-a922-d5dc68516704 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.909089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c066e-d730-4ddd-a922-d5dc68516704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.927665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 775/1560] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:45.929130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d651e-f91e-4237-995d-d6f3b34c8c26 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:45.929544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d651e-f91e-4237-995d-d6f3b34c8c26 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:45.930193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d651e-f91e-4237-995d-d6f3b34c8c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:45.938131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e59c066e-d730-4ddd-a922-d5dc68516704 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.939593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e59c066e-d730-4ddd-a922-d5dc68516704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:45.955231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-055d651e-f91e-4237-995d-d6f3b34c8c26 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:45.956689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-055d651e-f91e-4237-995d-d6f3b34c8c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:46.018146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 786/1561] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:46.019053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c066e-d730-4ddd-a922-d5dc68516704 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.033335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 776/1562] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:46.034911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502db-c9ec-423f-9aab-8b69b2c77fe4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.035152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502db-c9ec-423f-9aab-8b69b2c77fe4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.035495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502db-c9ec-423f-9aab-8b69b2c77fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.047717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c066e-d730-4ddd-a922-d5dc68516704 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.052921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d3b2-7a19-408b-b2ef-5b823e710c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.053660 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d3b2-7a19-408b-b2ef-5b823e710c12 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.054013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d3b2-7a19-408b-b2ef-5b823e710c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.054281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d3b2-7a19-408b-b2ef-5b823e710c12 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.054907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d3b2-7a19-408b-b2ef-5b823e710c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.055929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING py.warnings [None req-c276d3b2-7a19-408b-b2ef-5b823e710c12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:29:46.055929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: warnings.warn(msg) Sep 01 00:29:46.055929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: Sep 01 00:29:46.057166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d3b2-7a19-408b-b2ef-5b823e710c12 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.060668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b94502db-c9ec-423f-9aab-8b69b2c77fe4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:46.061974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b94502db-c9ec-423f-9aab-8b69b2c77fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:46.071875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 777/1563] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:46.073451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9e23c-8395-48ad-b366-2262200cb7fd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.073881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9e23c-8395-48ad-b366-2262200cb7fd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.074257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9e23c-8395-48ad-b366-2262200cb7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.083539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 787/1564] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/users => generated 287 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.084734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b931b8-b583-461f-a024-d662295a00e1 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.085016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b931b8-b583-461f-a024-d662295a00e1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.085287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b931b8-b583-461f-a024-d662295a00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.101695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a2d9e23c-8395-48ad-b366-2262200cb7fd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:46.103164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a2d9e23c-8395-48ad-b366-2262200cb7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:46.105817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e6b931b8-b583-461f-a024-d662295a00e1 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:46.106924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e6b931b8-b583-461f-a024-d662295a00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:46.111946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 778/1565] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:46.112897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9e23c-8395-48ad-b366-2262200cb7fd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.116614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 788/1566] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:46.117566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b931b8-b583-461f-a024-d662295a00e1 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.125812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9e23c-8395-48ad-b366-2262200cb7fd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.130071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b931b8-b583-461f-a024-d662295a00e1 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.130805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.131493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.131774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.132042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.133017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.135769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.136681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10664162-9d89-4467-a462-f04d2a6ac2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.137349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664162-9d89-4467-a462-f04d2a6ac2fb admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.137690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664162-9d89-4467-a462-f04d2a6ac2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.138018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10664162-9d89-4467-a462-f04d2a6ac2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.138779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10664162-9d89-4467-a462-f04d2a6ac2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:46.139089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10664162-9d89-4467-a462-f04d2a6ac2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.140778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10664162-9d89-4467-a462-f04d2a6ac2fb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.154739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 789/1567] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:46.162683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4c5b-e31e-4279-b757-2ba92b2dd7d3 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.162683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4c5b-e31e-4279-b757-2ba92b2dd7d3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.162683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4c5b-e31e-4279-b757-2ba92b2dd7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.170740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 779/1568] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/users => generated 296 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.174019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.189523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69e8e-8399-4015-85bb-4a65b1650eae admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.196371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.197163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.197622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.197944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.198820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:46.199262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.201633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.210840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e30a4c5b-e31e-4279-b757-2ba92b2dd7d3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:46.212476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e30a4c5b-e31e-4279-b757-2ba92b2dd7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:46.216813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 780/1569] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:46.217833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.224925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 790/1570] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:46.227899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758c59-7137-44b6-891f-8261a1905df9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.228443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758c59-7137-44b6-891f-8261a1905df9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.229155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758c59-7137-44b6-891f-8261a1905df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.229606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c046e6-e8ea-47ca-ac00-e10045638375 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.234746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.235409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.235694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.235963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.236806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.238628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.240286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.257252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 781/1571] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:46.258915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.259282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-92758c59-7137-44b6-891f-8261a1905df9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:46.260797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-92758c59-7137-44b6-891f-8261a1905df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:46.271364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 791/1572] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:46.272518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c244-f919-4829-a89b-9d851c2b46b9 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.273234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758c59-7137-44b6-891f-8261a1905df9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.277420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.278106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.278516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.278858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.279784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:46.280101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.282015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.286195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758c59-7137-44b6-891f-8261a1905df9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.292155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.293429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.294150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.294592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.295392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.302974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 782/1573] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:46.302974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.303275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.310619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8c19c-3088-4b76-83f3-60a852d6987f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.316502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.317268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.317651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.318014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.319298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.321213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.336458 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 792/1574] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.336678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 783/1575] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:46.336678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.337504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.347212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26efd1-b9ee-49ae-b24c-d17de4e204c2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.410556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671a667-b839-4b9e-aa8d-19bc40240c1f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.414102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.414953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.415379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.415516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.415959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.416081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.416307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.416605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.417234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.417933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:46.418435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.419285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.420916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.434937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 784/1576] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:46.441978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.445754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.455161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6a41f-4170-401c-8590-d703cf549e6b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.458592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 793/1577] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.460073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.463152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.463894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.464208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.466755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.467417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.469780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.484436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 785/1578] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:46.484436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.493573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cd5ae-e660-464a-b4c0-15e4af62e0a3 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.565165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7bd1-2dca-4cfb-abfd-a628c998911a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.565575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.566595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.567090 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.567366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.568079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.570312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.570880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.571478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.571768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.572049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.573275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:46.573275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.574749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.597683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 794/1579] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:46.600264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.612235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f176f-fd2a-4a82-b31b-24afce8b6086 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.620072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 786/1580] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.620349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.621062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.621205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.621524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.621798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.622540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.624799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.655159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 795/1581] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/users => generated 284 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.656720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.668174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f089d-57a3-4695-a761-256b2dd6ef17 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.684717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.715301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef31ca-ddd3-4301-a79c-24a5b70d3ae7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.720856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.721488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.721904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.722412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.723832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.724839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.741947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 787/1582] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:46.741947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.757807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacdb36-ee81-4d06-b82b-4a8bae062055 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.768708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.769249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.769533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.769795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.770427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.772424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.779745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.780341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.780788 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.781025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.781634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.783926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.821423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 788/1583] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/users => generated 296 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.821423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.821744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 796/1584] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.824772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.832419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef8826-5060-4446-ae7c-338756d7079a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.899982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.900701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.900981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.901251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] PATH_INFO: `/v3/projects/0b5f6df07c274662833ca68e3b158979/users/304b9eedb6b445ca9f766d4aa86b5483/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.906038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd445950-e605-461c-8a10-71378f9efae8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:46.913137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:46.916467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:46.917027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:46.917491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:46.918463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.919697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5f6df07c274662833ca68e3b158979, user_id=304b9eedb6b445ca9f766d4aa86b5483, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:46.921592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.922388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:46.928602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.946540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 789/1585] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:46 2022] PUT /identity/v3/projects/0b5f6df07c274662833ca68e3b158979/users/304b9eedb6b445ca9f766d4aa86b5483/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:46.947373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:46.978636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 797/1586] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:46.980059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.023369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c396ed1-396b-4c99-bb84-198fae998de7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.071265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e8241-24f3-4d45-8ad4-5901da7cf61b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.085611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:47.091783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.092505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.093301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.093584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.094293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.095991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.101898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.102831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.103369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.104110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.105706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.107832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.110741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 798/1587] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.111583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.133189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9932-ca65-4000-b671-87f405061bc6 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.138653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.139662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.140158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.140661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] PATH_INFO: `/v3/projects/0db9ba050d9647369cf0df7d835a524a/users/7dd2273d28c14633bd62e590171dac31/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.143538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 790/1588] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:46 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:47.145265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.157400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816477a0-c8aa-4154-89d2-aee9761b8cb5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.159717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db9ba050d9647369cf0df7d835a524a, user_id=7dd2273d28c14633bd62e590171dac31, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.162415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c854e2-f8b4-489f-8059-768650e03ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.163024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c854e2-f8b4-489f-8059-768650e03ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.163306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c854e2-f8b4-489f-8059-768650e03ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.163710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c854e2-f8b4-489f-8059-768650e03ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.164486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c854e2-f8b4-489f-8059-768650e03ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.164802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.167054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c854e2-f8b4-489f-8059-768650e03ba1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.184165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 799/1589] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:47 2022] PUT /identity/v3/projects/0db9ba050d9647369cf0df7d835a524a/users/7dd2273d28c14633bd62e590171dac31/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:47.185354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.210588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 791/1590] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:47 2022] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:47.212178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dcfe-39a1-455a-bc0d-f70e3f801ccf None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.212497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dcfe-39a1-455a-bc0d-f70e3f801ccf None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.212772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dcfe-39a1-455a-bc0d-f70e3f801ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.263852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b0f2dcfe-39a1-455a-bc0d-f70e3f801ccf None None] MFA Rules not processed for user `304b9eedb6b445ca9f766d4aa86b5483`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:47.265617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b0f2dcfe-39a1-455a-bc0d-f70e3f801ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:47.283304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bbb3b-0030-43d1-9319-7f07d6ca2247 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.288840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.289448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.289873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.290182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.291282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.292724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.303912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 800/1591] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.304931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.320700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7381-3081-4d56-9ebd-08fce61f342f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.329991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.331041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.331325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.331594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.332248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.336679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.364908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 801/1592] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:47 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:47.366403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.383598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf5222-e030-4aa7-87d2-afef3626d820 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.389752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 792/1593] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:47.389752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dcfe-39a1-455a-bc0d-f70e3f801ccf None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.401376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dcfe-39a1-455a-bc0d-f70e3f801ccf None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.491783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b027e-37d4-4d41-985e-5e92c5e7410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.491783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b027e-37d4-4d41-985e-5e92c5e7410a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.491783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b027e-37d4-4d41-985e-5e92c5e7410a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.491783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b027e-37d4-4d41-985e-5e92c5e7410a admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.494567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b027e-37d4-4d41-985e-5e92c5e7410a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.494809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.494809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.495550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b027e-37d4-4d41-985e-5e92c5e7410a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.495651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.495651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.495651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.495651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.495985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 802/1594] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.495985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7242f-f7bd-4a2f-828b-1275965722ba None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.495985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7242f-f7bd-4a2f-828b-1275965722ba None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.495985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7242f-f7bd-4a2f-828b-1275965722ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.496312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 793/1595] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.496312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.499375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d7c7242f-f7bd-4a2f-828b-1275965722ba None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:47.499776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2f8f-2e80-40af-8f1d-abdb977f084a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.500894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d7c7242f-f7bd-4a2f-828b-1275965722ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:47.515077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.516241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.519914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 803/1596] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:47.520877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.521430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7242f-f7bd-4a2f-828b-1275965722ba None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.521574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.521574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.528178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.540702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7242f-f7bd-4a2f-828b-1275965722ba None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.542923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 794/1597] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.543873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.547139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd276ec7-ae95-4c5f-9eac-f4b88c2ca141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.547802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276ec7-ae95-4c5f-9eac-f4b88c2ca141 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.548083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276ec7-ae95-4c5f-9eac-f4b88c2ca141 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.548424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276ec7-ae95-4c5f-9eac-f4b88c2ca141 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.549104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd276ec7-ae95-4c5f-9eac-f4b88c2ca141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.551519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd276ec7-ae95-4c5f-9eac-f4b88c2ca141 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.555685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdefb3-b605-40be-9616-ef9ebef2b323 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.565558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.566240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.566590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.566761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 804/1598] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.567083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.567957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.568782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f4ac8-f83a-4731-9ded-ba4b252c0bc0 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.569229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f4ac8-f83a-4731-9ded-ba4b252c0bc0 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.569871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f4ac8-f83a-4731-9ded-ba4b252c0bc0 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.570785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.572183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 805/1599] 10.222.0.13 () {54 vars in 962 bytes} [Thu Sep 1 00:29:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:29:47.573509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f4ac8-f83a-4731-9ded-ba4b252c0bc0 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.591905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f4ac8-f83a-4731-9ded-ba4b252c0bc0 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.596680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 795/1600] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.597749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.610142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.611156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.611720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.612021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bfb1f-82cb-4328-b47e-ef264407fe9e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.612577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] PATH_INFO: `/v3/projects/4defd37a657d4be784fb04f671eed806/users/541ec18ba307497dbfafdae7f4926bb9/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.615891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:47.619021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.619669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.619949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.620685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.621343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.623020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.634219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4defd37a657d4be784fb04f671eed806, user_id=541ec18ba307497dbfafdae7f4926bb9, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.636590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 796/1601] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.637531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.637666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.653762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 806/1602] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:47 2022] PUT /identity/v3/projects/4defd37a657d4be784fb04f671eed806/users/541ec18ba307497dbfafdae7f4926bb9/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:47.654857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.702684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09161-b03f-4678-a88e-35ac534e07c3 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.726789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:47.738582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08655ba-893f-48ce-8124-825d15ef9fca admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.743663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.744418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.744891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.745232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.746192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.747685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.759048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 807/1603] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.759948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.763868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60c81-ae2d-47ca-9cb0-457a5f15bc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.764815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60c81-ae2d-47ca-9cb0-457a5f15bc07 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.765198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60c81-ae2d-47ca-9cb0-457a5f15bc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.765576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60c81-ae2d-47ca-9cb0-457a5f15bc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.772635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064122-6a34-4687-a7e0-14f451fff78b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.781081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.782012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.782843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60c81-ae2d-47ca-9cb0-457a5f15bc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.784293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60c81-ae2d-47ca-9cb0-457a5f15bc07 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.784778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.785076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] PATH_INFO: `/v3/projects/47410b17e7fb4e4a8b51cd6b56dfc00f/users/7a9e8959054f4b68973559f9adb26119/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.797289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 797/1604] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:47.798766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b770538-b2c5-4993-90d3-58c2e6bb5668 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.799059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b770538-b2c5-4993-90d3-58c2e6bb5668 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.799334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b770538-b2c5-4993-90d3-58c2e6bb5668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.808274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47410b17e7fb4e4a8b51cd6b56dfc00f, user_id=7a9e8959054f4b68973559f9adb26119, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.811141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.829969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 808/1605] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:47 2022] PUT /identity/v3/projects/47410b17e7fb4e4a8b51cd6b56dfc00f/users/7a9e8959054f4b68973559f9adb26119/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:47.831241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.843789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4b770538-b2c5-4993-90d3-58c2e6bb5668 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:47.845300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4b770538-b2c5-4993-90d3-58c2e6bb5668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:47.948196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f70b-2c9f-4fc0-8329-b2e7750e863f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.955943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cfe74-814e-4ea3-9e8a-576a5dee9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:47.956866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cfe74-814e-4ea3-9e8a-576a5dee9bab admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.957427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cfe74-814e-4ea3-9e8a-576a5dee9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.957850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cfe74-814e-4ea3-9e8a-576a5dee9bab admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:47.958868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cfe74-814e-4ea3-9e8a-576a5dee9bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:47.963573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cfe74-814e-4ea3-9e8a-576a5dee9bab admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:47.966730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 798/1606] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Sep 1 00:29:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:47.975870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b770538-b2c5-4993-90d3-58c2e6bb5668 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:47.988116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b770538-b2c5-4993-90d3-58c2e6bb5668 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:47.989380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 809/1607] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:47.994368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac8b1-4bff-4930-991d-c298b46c2580 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:47.995395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac8b1-4bff-4930-991d-c298b46c2580 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:47.995829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac8b1-4bff-4930-991d-c298b46c2580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.004483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:48.005356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.006306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.007216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] PATH_INFO: `/v3/projects/60ed59738f11496c96bfb15ecb868560/users/888e94e8319147fe8bf9b3f80dfd8bb0/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.040861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-141ac8b1-4bff-4930-991d-c298b46c2580 None None] MFA Rules not processed for user `541ec18ba307497dbfafdae7f4926bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:48.042614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-141ac8b1-4bff-4930-991d-c298b46c2580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:48.043723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ed59738f11496c96bfb15ecb868560, user_id=888e94e8319147fe8bf9b3f80dfd8bb0, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:48.047730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:48.078624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 799/1608] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:47 2022] PUT /identity/v3/projects/60ed59738f11496c96bfb15ecb868560/users/888e94e8319147fe8bf9b3f80dfd8bb0/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:48.079403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:48.114816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:48.154930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 810/1609] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:48.156735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fba48-0aff-4d46-abf2-303a52ac0194 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.157202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fba48-0aff-4d46-abf2-303a52ac0194 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.157481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fba48-0aff-4d46-abf2-303a52ac0194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.196325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-627fba48-0aff-4d46-abf2-303a52ac0194 None None] MFA Rules not processed for user `7a9e8959054f4b68973559f9adb26119`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:48.197882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-627fba48-0aff-4d46-abf2-303a52ac0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:48.209614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011087-31b2-4f9f-8745-63d1fc728f38 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:48.215780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:48.216752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.217262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.217636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] PATH_INFO: `/v3/projects/b9c1dd8fb1c944d781f8d6b64d998623/users/77cdd85bff5d4911b351f34b2e13c5f4/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.238758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c1dd8fb1c944d781f8d6b64d998623, user_id=77cdd85bff5d4911b351f34b2e13c5f4, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:48.243402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:48.264764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 800/1610] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:48 2022] PUT /identity/v3/projects/b9c1dd8fb1c944d781f8d6b64d998623/users/77cdd85bff5d4911b351f34b2e13c5f4/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:48.265837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:48.272149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:48.360819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 811/1611] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:48.360819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fba48-0aff-4d46-abf2-303a52ac0194 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:48.384005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fba48-0aff-4d46-abf2-303a52ac0194 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:48.385463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c361f6-a888-4b71-a2bf-7ecc2577ae2e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:48.392969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ffc6f-aedc-4c77-96f7-212674be04c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:48.396055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ffc6f-aedc-4c77-96f7-212674be04c1 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.396630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ffc6f-aedc-4c77-96f7-212674be04c1 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.397070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ffc6f-aedc-4c77-96f7-212674be04c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.463175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589f04-e807-4c4c-ac8a-7862717eaccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:48.464407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589f04-e807-4c4c-ac8a-7862717eaccb admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.465036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589f04-e807-4c4c-ac8a-7862717eaccb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.465545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589f04-e807-4c4c-ac8a-7862717eaccb admin admin] PATH_INFO: `/v3/projects/e37d794ba6bb434aaac40a8f69e862d7/users/1b4aee995e4a4bb7a85cd1500e488a9a/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.503872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ffc6f-aedc-4c77-96f7-212674be04c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:48.506295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ffc6f-aedc-4c77-96f7-212674be04c1 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:48.510060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589f04-e807-4c4c-ac8a-7862717eaccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37d794ba6bb434aaac40a8f69e862d7, user_id=1b4aee995e4a4bb7a85cd1500e488a9a, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:48.517283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 801/1612] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:48.519002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9185eaf-162e-4237-88bb-4655d2844787 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.519289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9185eaf-162e-4237-88bb-4655d2844787 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.519559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9185eaf-162e-4237-88bb-4655d2844787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.532240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589f04-e807-4c4c-ac8a-7862717eaccb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:48.544794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a9185eaf-162e-4237-88bb-4655d2844787 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:48.547211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a9185eaf-162e-4237-88bb-4655d2844787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:48.557118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 802/1613] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:48.558027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9185eaf-162e-4237-88bb-4655d2844787 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:48.583127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 812/1614] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:48 2022] PUT /identity/v3/projects/e37d794ba6bb434aaac40a8f69e862d7/users/1b4aee995e4a4bb7a85cd1500e488a9a/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:48.584869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb1b9c-e65e-4565-9528-9d1a763cc82d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.585167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9185eaf-162e-4237-88bb-4655d2844787 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:48.587665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb1b9c-e65e-4565-9528-9d1a763cc82d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.595793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb1b9c-e65e-4565-9528-9d1a763cc82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.655815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-78bb1b9c-e65e-4565-9528-9d1a763cc82d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:48.658173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-78bb1b9c-e65e-4565-9528-9d1a763cc82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:48.682792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:48.684077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.684360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.684654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.685288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:48.687546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:48.724758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 803/1615] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:48 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:48.727700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:48.772609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:48.775870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:48.800573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 813/1616] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:48.804497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140a5b-cb30-42c3-a450-101b5ae08990 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.804889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140a5b-cb30-42c3-a450-101b5ae08990 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.805259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140a5b-cb30-42c3-a450-101b5ae08990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.874272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cb140a5b-cb30-42c3-a450-101b5ae08990 None None] MFA Rules not processed for user `1b4aee995e4a4bb7a85cd1500e488a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:48.877569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cb140a5b-cb30-42c3-a450-101b5ae08990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:48.879761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5af355-5ca2-4af1-acac-2df46cdf6679 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:48.893591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:48.894351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:48.894632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:48.894901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:48.895542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:48.903586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:48.960941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 804/1617] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:48 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:48.961964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.031444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 814/1618] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:49.032989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140a5b-cb30-42c3-a450-101b5ae08990 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.082526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140a5b-cb30-42c3-a450-101b5ae08990 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.128819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda75b28-19ad-4204-90be-b0803a2eeb30 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.137063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae80a3-ce91-4c92-86d8-304a342b4523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.146570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae80a3-ce91-4c92-86d8-304a342b4523 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.149094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae80a3-ce91-4c92-86d8-304a342b4523 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.149482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae80a3-ce91-4c92-86d8-304a342b4523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.220793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.221753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.222559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.222993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.223795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.226504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.258273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 815/1619] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:49 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:49.259415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.279265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc28bbb-3792-4a8e-9645-cd1cd8cf94dd admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.285310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac520eb-7a5c-400b-a697-9c7f3dafb484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.286343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac520eb-7a5c-400b-a697-9c7f3dafb484 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.286806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac520eb-7a5c-400b-a697-9c7f3dafb484 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.287618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac520eb-7a5c-400b-a697-9c7f3dafb484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.309596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae80a3-ce91-4c92-86d8-304a342b4523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.310754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac520eb-7a5c-400b-a697-9c7f3dafb484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.311279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae80a3-ce91-4c92-86d8-304a342b4523 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.313471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac520eb-7a5c-400b-a697-9c7f3dafb484 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.328501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 816/1620] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:49.330173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9305f1-1c5c-4133-b141-d011053aef1b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.330599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9305f1-1c5c-4133-b141-d011053aef1b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.331070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9305f1-1c5c-4133-b141-d011053aef1b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.332749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 817/1621] 10.222.0.13 () {54 vars in 912 bytes} [Thu Sep 1 00:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:29:49.334486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9305f1-1c5c-4133-b141-d011053aef1b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.336899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 805/1622] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:49.344678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97fd81-9db8-452e-81a7-56d1c5e3a809 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.345058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97fd81-9db8-452e-81a7-56d1c5e3a809 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.345438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97fd81-9db8-452e-81a7-56d1c5e3a809 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.347324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 806/1623] 10.222.0.13 () {54 vars in 962 bytes} [Thu Sep 1 00:29:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:29:49.348009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97fd81-9db8-452e-81a7-56d1c5e3a809 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.355554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9305f1-1c5c-4133-b141-d011053aef1b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.360875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47db9-9cc3-433a-adaa-cd3ae82104b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.361668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47db9-9cc3-433a-adaa-cd3ae82104b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.362018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47db9-9cc3-433a-adaa-cd3ae82104b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.362667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47db9-9cc3-433a-adaa-cd3ae82104b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.363438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47db9-9cc3-433a-adaa-cd3ae82104b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.366257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47db9-9cc3-433a-adaa-cd3ae82104b4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.379834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97fd81-9db8-452e-81a7-56d1c5e3a809 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.394422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8a9d8-51e3-4bef-8769-23e98f54cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.394701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a9d8-51e3-4bef-8769-23e98f54cbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.395191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a9d8-51e3-4bef-8769-23e98f54cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.395542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a9d8-51e3-4bef-8769-23e98f54cbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.396263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8a9d8-51e3-4bef-8769-23e98f54cbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.398767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8a9d8-51e3-4bef-8769-23e98f54cbc9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.398908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 818/1624] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:49 2022] POST /identity/v3/users => generated 303 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:49.400360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994130d4-4521-49f2-9a9b-912987babee7 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.400812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994130d4-4521-49f2-9a9b-912987babee7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.401232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994130d4-4521-49f2-9a9b-912987babee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.421867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 807/1625] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:49.428608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-994130d4-4521-49f2-9a9b-912987babee7 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:49.428803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668df5c-e84d-4414-a1bf-7c217e0328b1 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.428907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668df5c-e84d-4414-a1bf-7c217e0328b1 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.429197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668df5c-e84d-4414-a1bf-7c217e0328b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.430696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-994130d4-4521-49f2-9a9b-912987babee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:49.478744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4668df5c-e84d-4414-a1bf-7c217e0328b1 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:49.480484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4668df5c-e84d-4414-a1bf-7c217e0328b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:49.494985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:49.571934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 819/1626] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:49.572951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994130d4-4521-49f2-9a9b-912987babee7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.591341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:49.596833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994130d4-4521-49f2-9a9b-912987babee7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.605480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.606104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.606379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.606657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.607291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.609072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.636868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 820/1627] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:49.640758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.652100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1860ca-e8e8-4cfa-9b21-43f222a82c99 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.664410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 808/1628] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Sep 1 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:49.665934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.666616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.667499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.667499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] PATH_INFO: `/v3/projects/89b01190fe464f58925fe5a0e2ddb5f9/users/855e2fbbf46a473f9461d9fb88dd9299/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.673524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668df5c-e84d-4414-a1bf-7c217e0328b1 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.702297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b01190fe464f58925fe5a0e2ddb5f9, user_id=855e2fbbf46a473f9461d9fb88dd9299, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.706152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.730542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 821/1629] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:49 2022] PUT /identity/v3/projects/89b01190fe464f58925fe5a0e2ddb5f9/users/855e2fbbf46a473f9461d9fb88dd9299/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:49.731745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.827122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668df5c-e84d-4414-a1bf-7c217e0328b1 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.885736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a151-ffb9-4e12-8851-56dc231d3f47 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:49.901694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.902938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.903374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.903797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] PATH_INFO: `/v3/projects/377220961dad4e36a612d15eeeaed687/users/b88b898a31e7401f9ef6815666a612f7/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:49.929030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] RBAC: Authorizing `identity:create_grant(project_id=377220961dad4e36a612d15eeeaed687, user_id=b88b898a31e7401f9ef6815666a612f7, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:49.931991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:49.960478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 822/1630] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:49 2022] PUT /identity/v3/projects/377220961dad4e36a612d15eeeaed687/users/b88b898a31e7401f9ef6815666a612f7/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:49.962581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:49.962923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:49.964811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:49.966167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:49.966640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.094137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20200d6-c310-43f2-ba25-380bcc9a489c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:50.101409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:50.103130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:50.109299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:50.109938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.110366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.110541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.127904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 809/1631] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:50.131287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:50.162913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:50.163228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd570ed-b4f4-44c4-9b68-dae3834e5c9e service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:50.244207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:50.257676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:50.259482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:50.288689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 823/1632] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:50.290438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:50.305937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:50.306571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.306851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.308606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.309351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:50.312487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:50.336836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 810/1633] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:50.341158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:50.359164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f32a4-144c-44aa-8a96-49fff5fac54e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:50.372985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda69f0c-30c9-4eee-9c28-c5aaaa8b150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:50.374118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69f0c-30c9-4eee-9c28-c5aaaa8b150d admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.374632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69f0c-30c9-4eee-9c28-c5aaaa8b150d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.375296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69f0c-30c9-4eee-9c28-c5aaaa8b150d admin admin] PATH_INFO: `/v3/projects/89b01190fe464f58925fe5a0e2ddb5f9/users/855e2fbbf46a473f9461d9fb88dd9299/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.379143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda69f0c-30c9-4eee-9c28-c5aaaa8b150d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b01190fe464f58925fe5a0e2ddb5f9, user_id=855e2fbbf46a473f9461d9fb88dd9299, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:50.385997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda69f0c-30c9-4eee-9c28-c5aaaa8b150d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:50.428344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 811/1634] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:50 2022] PUT /identity/v3/projects/89b01190fe464f58925fe5a0e2ddb5f9/users/855e2fbbf46a473f9461d9fb88dd9299/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:50.438020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ef8a-7a0c-4f3b-bd40-b8eaefa93fe0 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.438530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ef8a-7a0c-4f3b-bd40-b8eaefa93fe0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.438804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ef8a-7a0c-4f3b-bd40-b8eaefa93fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.469977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ee181-0257-4a02-b130-8ef3fb3551a0 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:50.502080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ca11ef8a-7a0c-4f3b-bd40-b8eaefa93fe0 None None] MFA Rules not processed for user `855e2fbbf46a473f9461d9fb88dd9299`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:50.503367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ca11ef8a-7a0c-4f3b-bd40-b8eaefa93fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:50.659586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:50.660893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.661439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.664290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.665241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:50.667255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:50.682765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 812/1635] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:50.688411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11ef8a-7a0c-4f3b-bd40-b8eaefa93fe0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:50.699819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 824/1636] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:50.704135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:50.729278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092976b-f835-4a0d-9d9e-d7783e7ce3eb admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:50.741849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0dac5-04b6-455c-aecb-0b36e7c5efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:50.744163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0dac5-04b6-455c-aecb-0b36e7c5efa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.744831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0dac5-04b6-455c-aecb-0b36e7c5efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.745328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0dac5-04b6-455c-aecb-0b36e7c5efa3 admin admin] PATH_INFO: `/v3/projects/377220961dad4e36a612d15eeeaed687/users/b88b898a31e7401f9ef6815666a612f7/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.751528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0dac5-04b6-455c-aecb-0b36e7c5efa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377220961dad4e36a612d15eeeaed687, user_id=b88b898a31e7401f9ef6815666a612f7, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:50.757278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0dac5-04b6-455c-aecb-0b36e7c5efa3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:50.784352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 825/1637] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:50 2022] PUT /identity/v3/projects/377220961dad4e36a612d15eeeaed687/users/b88b898a31e7401f9ef6815666a612f7/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:50.795613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed4808-8b12-4e2b-9f97-86adeddf8741 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.796223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed4808-8b12-4e2b-9f97-86adeddf8741 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.796747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed4808-8b12-4e2b-9f97-86adeddf8741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.884639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-77ed4808-8b12-4e2b-9f97-86adeddf8741 None None] MFA Rules not processed for user `b88b898a31e7401f9ef6815666a612f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:50.884990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11ef8a-7a0c-4f3b-bd40-b8eaefa93fe0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:50.888727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-77ed4808-8b12-4e2b-9f97-86adeddf8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:50.971840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:50.972828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:50.973118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:50.973399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:50.988829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:50.994116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:51.093076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 826/1638] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:29:51.094680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6dc2-0f1a-4ca7-9651-754640bcc3c6 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:51.095256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:51.096073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6dc2-0f1a-4ca7-9651-754640bcc3c6 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:51.096550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6dc2-0f1a-4ca7-9651-754640bcc3c6 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:51.096671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:51.100009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 827/1639] 10.222.0.13 () {54 vars in 912 bytes} [Thu Sep 1 00:29:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:29:51.106129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3024d-41bf-42ba-98ee-91494f79af96 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:51.106664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3024d-41bf-42ba-98ee-91494f79af96 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:51.107142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3024d-41bf-42ba-98ee-91494f79af96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:51.121436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 813/1640] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:29:51.150069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b6f3024d-41bf-42ba-98ee-91494f79af96 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:51.152961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b6f3024d-41bf-42ba-98ee-91494f79af96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:51.210523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:51.230103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da8232-beef-40c4-906c-3da75e7c9c9b service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:51.257449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:51.259363 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:51.261953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:51.263001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:51.287731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:51.289595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:51.312411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 814/1641] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:51.402584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 828/1642] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:29:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:51.476594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:51.493771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3626-61c9-4b14-b45f-747dc5694927 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:51.508562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:51.509193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:51.509710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:51.510126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:51.545269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:51.548431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:51.612866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 815/1643] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:51.734817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3024d-41bf-42ba-98ee-91494f79af96 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:51.751119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3024d-41bf-42ba-98ee-91494f79af96 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:51.765879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efeafeb-3dd8-421f-82e4-090df1fcdf3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:51.766570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeafeb-3dd8-421f-82e4-090df1fcdf3e service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:51.766785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeafeb-3dd8-421f-82e4-090df1fcdf3e service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:51.767054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeafeb-3dd8-421f-82e4-090df1fcdf3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:51.903823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efeafeb-3dd8-421f-82e4-090df1fcdf3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:51.905701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efeafeb-3dd8-421f-82e4-090df1fcdf3e service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:51.921606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 829/1644] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:54.818625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:55.006310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26329a09-fe9f-4fd2-96b8-37cd8dc94b36 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:55.026815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:55.027472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:55.027746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:55.028479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] PATH_INFO: `/v3/users/304b9eedb6b445ca9f766d4aa86b5483` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:55.029668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304b9eedb6b445ca9f766d4aa86b5483)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:55.030715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: WARNING py.warnings [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:29:55.030715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: warnings.warn(msg) Sep 01 00:29:55.030715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: Sep 01 00:29:55.031996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:55.217264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304b9eedb6b445ca9f766d4aa86b5483'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:55.257782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304b9eedb6b445ca9f766d4aa86b5483'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:55.275658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304b9eedb6b445ca9f766d4aa86b5483'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:55.276686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304b9eedb6b445ca9f766d4aa86b5483'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:55.277551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-684c7291-23ce-49d6-95e4-1a2665e7a542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304b9eedb6b445ca9f766d4aa86b5483'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:55.332009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:55.343071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 816/1645] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:29:54 2022] DELETE /identity/v3/users/304b9eedb6b445ca9f766d4aa86b5483 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:55.344771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:55.345283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:55.345369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:55.414002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:55.415351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:55.600338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 830/1646] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:55.618493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:55.618773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:55.619043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:55.652824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:55.654360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:55.663490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:55.681530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] MFA Rules not processed for user `562fcce5b9be41908036832d4aed1dff`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:55.685731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:55.861981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04ac3d-dd56-4a3b-bdc7-26adb8aaca14 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:55.866843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 817/1647] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:55.872517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:55.874183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:55.875873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:55.876890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:55.878171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:55.878464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:55.923030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:55.925873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:55.970421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 831/1648] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:55.971872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d52b8-a597-42b9-ac12-5bc13c985c17 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:55.979468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:55.980039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:55.980315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:55.982334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:56.003124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:56.004812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:56.030214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 818/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:56.844890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:56.846416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:56.894854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919b4c-5e71-4cba-944e-bc866a622d93 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:56.927868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:56.928541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:56.928816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:56.929170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] PATH_INFO: `/v3/projects/0b5f6df07c274662833ca68e3b158979` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:56.931964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5f6df07c274662833ca68e3b158979)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:56.937650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: WARNING py.warnings [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 00:29:56.937650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: warnings.warn(msg) Sep 01 00:29:56.937650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: Sep 01 00:29:56.942114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:56.950091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:56.953153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:56.987189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0e86-600b-4a6b-975c-07a34a3f7fdf service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:57.002614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:57.032866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:57.033285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:57.033571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] PATH_INFO: `/v3/users/541ec18ba307497dbfafdae7f4926bb9` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:57.059388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=541ec18ba307497dbfafdae7f4926bb9)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:57.071282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:57.122778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5f6df07c274662833ca68e3b158979', 'request_id': 'req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.149011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5f6df07c274662833ca68e3b158979', 'request_id': 'req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.172703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5f6df07c274662833ca68e3b158979', 'request_id': 'req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.200649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] The token cache is being invalidate because project 0b5f6df07c274662833ca68e3b158979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:29:57.205849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.207174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.212148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 832/1650] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:29:56 2022] DELETE /identity/v3/projects/0b5f6df07c274662833ca68e3b158979 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:57.214463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:57.217588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:57.231331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '541ec18ba307497dbfafdae7f4926bb9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.249123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '541ec18ba307497dbfafdae7f4926bb9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.266331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '541ec18ba307497dbfafdae7f4926bb9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.267118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '541ec18ba307497dbfafdae7f4926bb9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.269084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-32dc00dd-7d17-421c-9e76-538b9b9a6e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '541ec18ba307497dbfafdae7f4926bb9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.281751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:57.325853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 819/1651] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:29:56 2022] DELETE /identity/v3/users/541ec18ba307497dbfafdae7f4926bb9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:29:57.330815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa9b2-c317-4e2d-8ca3-6ca42e47207a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:57.331106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa9b2-c317-4e2d-8ca3-6ca42e47207a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:57.334354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa9b2-c317-4e2d-8ca3-6ca42e47207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:57.395200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f11fa9b2-c317-4e2d-8ca3-6ca42e47207a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:57.401120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f11fa9b2-c317-4e2d-8ca3-6ca42e47207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:57.408993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434c6a-2d93-4ebd-9ef9-bb421189d9ba admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:57.544174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:57.589450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 820/1652] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:57.590922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:57.591208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:57.594048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:57.615377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:57.616036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:57.616312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:57.616621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] PATH_INFO: `/v3/users/1b4aee995e4a4bb7a85cd1500e488a9a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:57.619422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4aee995e4a4bb7a85cd1500e488a9a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:57.626665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:57.640712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:57.651559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:57.672194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 821/1653] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:57.677974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:57.679463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:57.712098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963696e-cdef-4c4b-8c6c-db4f892dd4ac None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:57.739382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:57.740544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:57.740818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:57.741125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] PATH_INFO: `/v3/users/7a9e8959054f4b68973559f9adb26119` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:57.742739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9e8959054f4b68973559f9adb26119)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:57.744733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:57.751881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4aee995e4a4bb7a85cd1500e488a9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.771941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4aee995e4a4bb7a85cd1500e488a9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.773251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4aee995e4a4bb7a85cd1500e488a9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.788841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4aee995e4a4bb7a85cd1500e488a9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.814368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-9deb1c20-8964-4595-8c45-780538407575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4aee995e4a4bb7a85cd1500e488a9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.830714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 833/1654] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:29:57 2022] DELETE /identity/v3/users/1b4aee995e4a4bb7a85cd1500e488a9a => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:57.835413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d538-2ade-449e-8dcc-8b26d7d857cd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:57.835822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d538-2ade-449e-8dcc-8b26d7d857cd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:57.836559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d538-2ade-449e-8dcc-8b26d7d857cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:57.857893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9e8959054f4b68973559f9adb26119'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.866631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9e8959054f4b68973559f9adb26119'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.878568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9e8959054f4b68973559f9adb26119'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.879563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9e8959054f4b68973559f9adb26119'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.880880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9e8959054f4b68973559f9adb26119'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:29:57.884919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1c53d538-2ade-449e-8dcc-8b26d7d857cd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:57.888624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1c53d538-2ade-449e-8dcc-8b26d7d857cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:57.931706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 822/1655] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:29:57 2022] DELETE /identity/v3/users/7a9e8959054f4b68973559f9adb26119 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:57.934541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:57.939529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:57.990801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 834/1656] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:57.992843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35d51-7670-459f-9e8a-45dfa2a12f27 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:57.993234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35d51-7670-459f-9e8a-45dfa2a12f27 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:57.993641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35d51-7670-459f-9e8a-45dfa2a12f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.019912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-02d35d51-7670-459f-9e8a-45dfa2a12f27 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:58.021941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-02d35d51-7670-459f-9e8a-45dfa2a12f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:58.077074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407b82-97df-4213-97a6-ec66f0c09427 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.088843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.089485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.089764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.090031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.093911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:58.106400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:58.132954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:58.148515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 835/1657] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:58.151079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e55bf-8005-4a2f-82c5-e931cc4d62f3 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.151607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e55bf-8005-4a2f-82c5-e931cc4d62f3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.151959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e55bf-8005-4a2f-82c5-e931cc4d62f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.176233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5c4e55bf-8005-4a2f-82c5-e931cc4d62f3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:58.177741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5c4e55bf-8005-4a2f-82c5-e931cc4d62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:58.193553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 836/1658] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:58.194803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e55bf-8005-4a2f-82c5-e931cc4d62f3 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.229925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e55bf-8005-4a2f-82c5-e931cc4d62f3 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.244141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.245293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.245807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.246502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.248275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:29:58.249040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.251814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.276208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.279900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.283085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 837/1659] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:29:58.285059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.299056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f494-bfa4-4140-9378-7ca17a2bd21a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.303487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.304663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.305455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.305801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.312923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 823/1660] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:58.313873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.319597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.321412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.333278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 838/1661] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:58.334242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.334407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26611dc4-b42e-4847-b993-c711fdb3058f service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.345664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e28c7-6cd4-471f-99e4-68dfbf38c3a7 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.349723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.350430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.350636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.350901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.356638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.357453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.357628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.358005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.358714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.362620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.370912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.372373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.390978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 824/1662] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:58.422186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 839/1663] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:29:58 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:58.425131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.441631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ec970-001b-4bf9-a2e6-5f153d94a242 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.563137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.567820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.569071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.569362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.571263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.578046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.628421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 825/1664] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:29:58 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:29:58.629902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.646653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35406659-4f86-4cda-8215-51306f99b2f2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.660141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.662679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.664097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.664440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.666720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.672421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.695791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 840/1665] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:58.698321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.709703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3448-8006-4fd9-8629-e8d064771572 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.723763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b763f57-79c4-43a8-891d-d5a4a228ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.724524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763f57-79c4-43a8-891d-d5a4a228ea00 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.724808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763f57-79c4-43a8-891d-d5a4a228ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.725084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763f57-79c4-43a8-891d-d5a4a228ea00 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.725789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b763f57-79c4-43a8-891d-d5a4a228ea00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.727406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b763f57-79c4-43a8-891d-d5a4a228ea00 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.760082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 826/1666] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:29:58.761348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:58.778876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7f0d7-fce4-42da-8bd8-d0c4bb9f00b2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:58.791797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:58.795204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.795500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.795782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] PATH_INFO: `/v3/projects/0def5c6075a0477eb5f39a8801b3f542/users/ff12966429754659a41733121c2cbe8a/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.841596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0def5c6075a0477eb5f39a8801b3f542, user_id=ff12966429754659a41733121c2cbe8a, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:58.846710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:58.874967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 841/1667] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:29:58 2022] PUT /identity/v3/projects/0def5c6075a0477eb5f39a8801b3f542/users/ff12966429754659a41733121c2cbe8a/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:29:58.888040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f717-77eb-473c-a41a-44fd1542f8bd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:58.888868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f717-77eb-473c-a41a-44fd1542f8bd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:58.888868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f717-77eb-473c-a41a-44fd1542f8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:58.934445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6655f717-77eb-473c-a41a-44fd1542f8bd None None] MFA Rules not processed for user `ff12966429754659a41733121c2cbe8a`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:58.936300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6655f717-77eb-473c-a41a-44fd1542f8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:59.029431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:59.055803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 827/1668] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:59.061526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:59.063297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:59.256695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47d349-a7a9-411d-9e6c-f4bde1c820b2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:29:59.262338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:29:59.262976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:59.263261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:59.263533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:59.280851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:29:59.291448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:29:59.326744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 842/1669] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:29:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:29:59.421531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124111a-2d6c-4e6b-b1ba-6c7f58d904fc None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:29:59.421531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124111a-2d6c-4e6b-b1ba-6c7f58d904fc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:29:59.421531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124111a-2d6c-4e6b-b1ba-6c7f58d904fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:29:59.536439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-8124111a-2d6c-4e6b-b1ba-6c7f58d904fc None None] MFA Rules not processed for user `7dd2273d28c14633bd62e590171dac31`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:29:59.537763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8124111a-2d6c-4e6b-b1ba-6c7f58d904fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:59.741929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:59.743829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:29:59.799422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 828/1670] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:29:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:29:59.800332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124111a-2d6c-4e6b-b1ba-6c7f58d904fc None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:29:59.954932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:00.008873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531b088-2f07-435a-b13f-34bb3bf22c1c service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:00.035087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:00.035916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:00.036371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:00.037236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] PATH_INFO: `/v3/projects/e37d794ba6bb434aaac40a8f69e862d7` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:00.039090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37d794ba6bb434aaac40a8f69e862d7)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:00.044943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:00.142987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124111a-2d6c-4e6b-b1ba-6c7f58d904fc None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:00.161765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:00.162434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:00.162714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:00.163089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] PATH_INFO: `/v3/users/ff12966429754659a41733121c2cbe8a` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:00.164796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff12966429754659a41733121c2cbe8a)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:00.174942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:00.240335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37d794ba6bb434aaac40a8f69e862d7', 'request_id': 'req-a4ded6be-8641-4a7b-b47a-6c9c997030b3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.250247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37d794ba6bb434aaac40a8f69e862d7', 'request_id': 'req-a4ded6be-8641-4a7b-b47a-6c9c997030b3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.265315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37d794ba6bb434aaac40a8f69e862d7', 'request_id': 'req-a4ded6be-8641-4a7b-b47a-6c9c997030b3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.312576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] The token cache is being invalidate because project e37d794ba6bb434aaac40a8f69e862d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:00.313597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.315461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a4ded6be-8641-4a7b-b47a-6c9c997030b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.323032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 843/1671] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:29:59 2022] DELETE /identity/v3/projects/e37d794ba6bb434aaac40a8f69e862d7 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:00.325324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99b7bc-dd53-4330-a69f-40ce38d32dce None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:00.326763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99b7bc-dd53-4330-a69f-40ce38d32dce None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:00.328072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff12966429754659a41733121c2cbe8a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.329922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99b7bc-dd53-4330-a69f-40ce38d32dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:00.349840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff12966429754659a41733121c2cbe8a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.387676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff12966429754659a41733121c2cbe8a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.388625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff12966429754659a41733121c2cbe8a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.389333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e66e900b-1511-4a24-8f46-ed5113fdb07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff12966429754659a41733121c2cbe8a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:00.412817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-9e99b7bc-dd53-4330-a69f-40ce38d32dce None None] MFA Rules not processed for user `7dd2273d28c14633bd62e590171dac31`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:00.415436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9e99b7bc-dd53-4330-a69f-40ce38d32dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:00.470082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 829/1672] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:29:59 2022] DELETE /identity/v3/users/ff12966429754659a41733121c2cbe8a => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:00.476611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:00.477138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:00.478264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:00.498987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:00.564809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:00.568779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:00.637641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 844/1673] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:00.642153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3953ee-3aa4-408f-8754-de1e269c7f03 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:00.642447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3953ee-3aa4-408f-8754-de1e269c7f03 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:00.643263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3953ee-3aa4-408f-8754-de1e269c7f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:00.731540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3d3953ee-3aa4-408f-8754-de1e269c7f03 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:00.735445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3d3953ee-3aa4-408f-8754-de1e269c7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:00.770120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 830/1674] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:00.770120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:00.774898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:00.890616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 845/1675] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:00.892072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef629b3-c16d-4197-8235-04d25d0b1f49 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:00.892451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef629b3-c16d-4197-8235-04d25d0b1f49 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:00.893035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef629b3-c16d-4197-8235-04d25d0b1f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:00.943459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1ef629b3-c16d-4197-8235-04d25d0b1f49 None None] MFA Rules not processed for user `562fcce5b9be41908036832d4aed1dff`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:00.948566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1ef629b3-c16d-4197-8235-04d25d0b1f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:00.971407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaa014-0263-45ad-b6a8-d82b3ac3bee8 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:00.996261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:00.997576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:00.998012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:00.998426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.010888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.041537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:01.105564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 846/1676] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:01.107187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:01.107579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:01.107953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.160999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:01.163333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:01.184146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 831/1677] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:01.184908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:01.185141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:01.186383 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.191229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.221854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d83d60-6c0e-41e7-b131-00fe1a8977b0 service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:01.222873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 847/1678] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:01.223853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:01.231369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.234283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:01.234938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:01.235471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:01.235745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] PATH_INFO: `/v3/projects/47410b17e7fb4e4a8b51cd6b56dfc00f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.237101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47410b17e7fb4e4a8b51cd6b56dfc00f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:01.239665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:01.328295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:01.360092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47410b17e7fb4e4a8b51cd6b56dfc00f', 'request_id': 'req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.372016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47410b17e7fb4e4a8b51cd6b56dfc00f', 'request_id': 'req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.375129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dee827-ab96-4602-9892-7e23942614f2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:01.393135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47410b17e7fb4e4a8b51cd6b56dfc00f', 'request_id': 'req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.423668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] The token cache is being invalidate because project 47410b17e7fb4e4a8b51cd6b56dfc00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:01.423889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.429028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.435092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 832/1679] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:01 2022] DELETE /identity/v3/projects/47410b17e7fb4e4a8b51cd6b56dfc00f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:01.435092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:01.437001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.512192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:01.512856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:01.513137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:01.513407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.517183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.578362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fbcd7-30a3-435a-ad80-07e2c7a13d2d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:01.583851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:01.584753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:01.585109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:01.585481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] PATH_INFO: `/v3/projects/4defd37a657d4be784fb04f671eed806` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.586782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4defd37a657d4be784fb04f671eed806)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:01.588901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:01.658710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:01.660578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:01.685029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 848/1680] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:01.687411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:01.689512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4defd37a657d4be784fb04f671eed806', 'request_id': 'req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.691555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.702286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4defd37a657d4be784fb04f671eed806', 'request_id': 'req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.717551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4defd37a657d4be784fb04f671eed806', 'request_id': 'req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.719985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962796d5-092e-4bc2-abf5-93766c30e9ad service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:01.742150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] The token cache is being invalidate because project 4defd37a657d4be784fb04f671eed806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:01.742622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.743530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:01.745699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 833/1681] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:01 2022] DELETE /identity/v3/projects/4defd37a657d4be784fb04f671eed806 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:01.747058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:01.748621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.809659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:01.856209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:01.872914 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84be93-e55c-4c7d-8a84-57b1f9a2679c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:01.873422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:01.874281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:01.874558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:01.874826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.877061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:01.878155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:01.879856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:01.887201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:01.887864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:01.888190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:01.889523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] PATH_INFO: `/v3/users/b88b898a31e7401f9ef6815666a612f7` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.893008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88b898a31e7401f9ef6815666a612f7)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:01.895263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:01.907913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 849/1682] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:01.910010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:01.915114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:01.939705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5466-0adb-451f-98bb-b80891833d95 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:01.950154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:01.950912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:01.951188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:01.951460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] PATH_INFO: `/v3/users/855e2fbbf46a473f9461d9fb88dd9299` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:01.957537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855e2fbbf46a473f9461d9fb88dd9299)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:01.960082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:02.003102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88b898a31e7401f9ef6815666a612f7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.021959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88b898a31e7401f9ef6815666a612f7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.049882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88b898a31e7401f9ef6815666a612f7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.052652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88b898a31e7401f9ef6815666a612f7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.055150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88b898a31e7401f9ef6815666a612f7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.091656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855e2fbbf46a473f9461d9fb88dd9299'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.104611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 834/1683] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:01 2022] DELETE /identity/v3/users/b88b898a31e7401f9ef6815666a612f7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:02.105883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:02.109433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:02.110693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855e2fbbf46a473f9461d9fb88dd9299'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.112274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855e2fbbf46a473f9461d9fb88dd9299'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.133372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855e2fbbf46a473f9461d9fb88dd9299'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.161255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855e2fbbf46a473f9461d9fb88dd9299'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.180245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 850/1684] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:01 2022] DELETE /identity/v3/users/855e2fbbf46a473f9461d9fb88dd9299 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:02.257648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ebe85-b8e2-4c42-8ee1-1c786dbca12a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:02.354097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:02.354973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:02.355255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:02.355531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:02.356173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:02.367399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:02.417160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 835/1685] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:02 2022] POST /identity/v3/projects => generated 369 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:02.418236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:02.420694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:02.450362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596fbe-5d75-40ee-a4f3-2d59c1c24f75 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:02.608411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:02.609084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:02.609428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:02.609764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:02.610480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:02.613704 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:02.658910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 851/1686] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:02 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:02.660101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:02.679064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04cc4e-f421-49a4-a8fe-8da4214db5c2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:02.687165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a53c-6ac5-4229-99ba-e7cd67612d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:02.687460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a53c-6ac5-4229-99ba-e7cd67612d72 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:02.692050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a53c-6ac5-4229-99ba-e7cd67612d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:02.692427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a53c-6ac5-4229-99ba-e7cd67612d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:02.694532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a53c-6ac5-4229-99ba-e7cd67612d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:02.699919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a53c-6ac5-4229-99ba-e7cd67612d72 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:02.707946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:02.736269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:02.745273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 836/1687] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:02.748254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b13fc-cf0a-46d2-b69b-663dd9865280 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:02.750431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b13fc-cf0a-46d2-b69b-663dd9865280 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:02.750995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b13fc-cf0a-46d2-b69b-663dd9865280 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:02.757734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0a467-58b6-4e1e-9d80-a7a21f2966f1 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:02.760904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 837/1688] 10.222.0.13 () {54 vars in 912 bytes} [Thu Sep 1 00:30:02 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:30:02.761897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b13fc-cf0a-46d2-b69b-663dd9865280 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:02.765864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bc2b13fc-cf0a-46d2-b69b-663dd9865280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:02.770119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c05e2-09f7-4ff5-8e41-ccb5634f3385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:02.772128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c05e2-09f7-4ff5-8e41-ccb5634f3385 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:02.772629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c05e2-09f7-4ff5-8e41-ccb5634f3385 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:02.773258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c05e2-09f7-4ff5-8e41-ccb5634f3385 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:02.775473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c05e2-09f7-4ff5-8e41-ccb5634f3385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:02.777843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c05e2-09f7-4ff5-8e41-ccb5634f3385 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:02.821983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b13fc-cf0a-46d2-b69b-663dd9865280 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:02.823790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 852/1689] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:02.826995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656434-4f7e-4ed8-b679-9672d039ebe6 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:02.827282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656434-4f7e-4ed8-b679-9672d039ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:02.827577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656434-4f7e-4ed8-b679-9672d039ebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:02.836093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:02.836782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:02.837057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:02.837421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] PATH_INFO: `/v3/projects/0def5c6075a0477eb5f39a8801b3f542` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:02.840086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0def5c6075a0477eb5f39a8801b3f542)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:02.843336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:02.918124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:02.939116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0c656434-4f7e-4ed8-b679-9672d039ebe6 None None] MFA Rules not processed for user `baa7f3487b674e75afe5fca74db44807`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:02.941990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0c656434-4f7e-4ed8-b679-9672d039ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:02.977739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0def5c6075a0477eb5f39a8801b3f542', 'request_id': 'req-947fb8b9-633e-4eac-9fda-903aa97b2c1a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:02.998673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0def5c6075a0477eb5f39a8801b3f542', 'request_id': 'req-947fb8b9-633e-4eac-9fda-903aa97b2c1a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.028594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0def5c6075a0477eb5f39a8801b3f542', 'request_id': 'req-947fb8b9-633e-4eac-9fda-903aa97b2c1a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.069098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] The token cache is being invalidate because project 0def5c6075a0477eb5f39a8801b3f542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:03.070300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.073569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.078132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 838/1690] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:02 2022] DELETE /identity/v3/projects/0def5c6075a0477eb5f39a8801b3f542 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:03.079302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:03.081743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 853/1691] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:30:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:03.082682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.085349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.085640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.087254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.143550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:03.148254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.260159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fb8b9-633e-4eac-9fda-903aa97b2c1a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:03.276149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871e2ed-b859-4a80-b8b1-b8ddba8d2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:03.277304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e2ed-b859-4a80-b8b1-b8ddba8d2835 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.289385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e2ed-b859-4a80-b8b1-b8ddba8d2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.289617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 854/1692] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:03.290506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:03.295533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.298611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e2ed-b859-4a80-b8b1-b8ddba8d2835 admin admin] PATH_INFO: `/v3/projects/d428d978710e4d8da8e31137a4f699c3/users/e9817b9fc093493db3211f5ea1fa4af4/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.319204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377b304-04d9-4c88-9a70-88e1308886fd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:03.328237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871e2ed-b859-4a80-b8b1-b8ddba8d2835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d428d978710e4d8da8e31137a4f699c3, user_id=e9817b9fc093493db3211f5ea1fa4af4, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:03.329443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8839dd9-dd18-4be8-8f03-610d058005d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:03.330077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8839dd9-dd18-4be8-8f03-610d058005d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.330357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8839dd9-dd18-4be8-8f03-610d058005d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.330630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8839dd9-dd18-4be8-8f03-610d058005d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.332499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e8839dd9-dd18-4be8-8f03-610d058005d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.332920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871e2ed-b859-4a80-b8b1-b8ddba8d2835 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:03.357640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8839dd9-dd18-4be8-8f03-610d058005d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:03.359092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8839dd9-dd18-4be8-8f03-610d058005d0 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:03.378020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 855/1693] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:03.383583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 839/1694] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:03 2022] PUT /identity/v3/projects/d428d978710e4d8da8e31137a4f699c3/users/e9817b9fc093493db3211f5ea1fa4af4/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:03.387486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e470-1b00-4a03-9aca-6876be0ff78e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.388299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e470-1b00-4a03-9aca-6876be0ff78e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.389405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e470-1b00-4a03-9aca-6876be0ff78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.397339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9938-bb9c-4ddb-8256-bf72b0764fed None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.397680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9938-bb9c-4ddb-8256-bf72b0764fed None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.398001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9938-bb9c-4ddb-8256-bf72b0764fed None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.404614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 856/1695] 10.222.0.13 () {54 vars in 912 bytes} [Thu Sep 1 00:30:03 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:30:03.416526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.416526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.416526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.448060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-aed9e470-1b00-4a03-9aca-6876be0ff78e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:03.453064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-aed9e470-1b00-4a03-9aca-6876be0ff78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.487084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] MFA Rules not processed for user `e9817b9fc093493db3211f5ea1fa4af4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:03.491026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.612874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 840/1696] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:03.620145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.620537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.620730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.633952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 857/1697] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:03.634892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:03.640194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:03.642145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.669685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] MFA Rules not processed for user `baa7f3487b674e75afe5fca74db44807`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:03.673142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430249c-eef4-4599-bb82-64cd22af19d5 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:03.686857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.710273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:03.710515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.710981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.711281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] PATH_INFO: `/v3/projects/89b01190fe464f58925fe5a0e2ddb5f9` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.712624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b01190fe464f58925fe5a0e2ddb5f9)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:03.714661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:03.753697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 841/1698] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:03.755931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:03.757067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.774253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6164bd-6676-4d53-8cbf-3b5966ef2cf4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:03.779850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:03.780038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:03.780247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:03.780454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] PATH_INFO: `/v3/projects/377220961dad4e36a612d15eeeaed687` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:03.781809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=377220961dad4e36a612d15eeeaed687)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:03.784564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:03.812046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:03.845636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b01190fe464f58925fe5a0e2ddb5f9', 'request_id': 'req-80388428-9311-4e81-b5d1-5d4de1650710'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.875354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b01190fe464f58925fe5a0e2ddb5f9', 'request_id': 'req-80388428-9311-4e81-b5d1-5d4de1650710'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.890522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377220961dad4e36a612d15eeeaed687', 'request_id': 'req-d1bd34dc-a85b-4a85-a552-a16538304dbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.896751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b01190fe464f58925fe5a0e2ddb5f9', 'request_id': 'req-80388428-9311-4e81-b5d1-5d4de1650710'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.920039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377220961dad4e36a612d15eeeaed687', 'request_id': 'req-d1bd34dc-a85b-4a85-a552-a16538304dbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.933818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] The token cache is being invalidate because project 89b01190fe464f58925fe5a0e2ddb5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:03.934122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.936672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.937801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377220961dad4e36a612d15eeeaed687', 'request_id': 'req-d1bd34dc-a85b-4a85-a552-a16538304dbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.942421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 858/1699] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:03 2022] DELETE /identity/v3/projects/89b01190fe464f58925fe5a0e2ddb5f9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:03.943184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:03.949522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:03.965335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] The token cache is being invalidate because project 377220961dad4e36a612d15eeeaed687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:03.965663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.967172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:03.971903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 842/1700] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:03 2022] DELETE /identity/v3/projects/377220961dad4e36a612d15eeeaed687 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:03.972827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:03.975421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.095345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd34dc-a85b-4a85-a552-a16538304dbb admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.097620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388428-9311-4e81-b5d1-5d4de1650710 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.101944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668a730-98f7-4466-8af6-d711e5128454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.103061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668a730-98f7-4466-8af6-d711e5128454 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.103340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668a730-98f7-4466-8af6-d711e5128454 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.105172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668a730-98f7-4466-8af6-d711e5128454 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.106961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668a730-98f7-4466-8af6-d711e5128454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.107336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.108072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.108238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.109095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.109821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:04.110131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.111612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668a730-98f7-4466-8af6-d711e5128454 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.112011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.129674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 859/1701] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:04.131211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.134575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.160678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 843/1702] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:03 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:04.163049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e545a-915a-4e55-a29c-0a61fea35374 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.163546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e545a-915a-4e55-a29c-0a61fea35374 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.164121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e545a-915a-4e55-a29c-0a61fea35374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.191794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b68e545a-915a-4e55-a29c-0a61fea35374 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:04.194385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b68e545a-915a-4e55-a29c-0a61fea35374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.220110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:04.248883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37beb9a0-34ff-4e4c-93ea-a10a3f55145a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.357356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 844/1703] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:04.362818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.363917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.364983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.396271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:04.397790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.399841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.400486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.400756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.401030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.402815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.406668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 845/1704] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:04.415654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.417284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.433140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241d30-69dd-4f21-91b2-472073728e2c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.434801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.436270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.438916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.439912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.440258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.440635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.441349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.443492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.452840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 860/1705] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:04.453706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.517573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74a3b-8b9e-4019-9c9b-a5d641cbd26f service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.538983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81527859-674b-4b58-8ba7-54e882b8935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.539534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81527859-674b-4b58-8ba7-54e882b8935f admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.539786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81527859-674b-4b58-8ba7-54e882b8935f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.540112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81527859-674b-4b58-8ba7-54e882b8935f admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.544219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81527859-674b-4b58-8ba7-54e882b8935f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.550791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81527859-674b-4b58-8ba7-54e882b8935f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.561185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 846/1706] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:04.561796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:04.562218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.566410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.592866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 861/1707] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:04.592866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff9c8-aef2-4aed-9328-58c82b2e661c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.592866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff9c8-aef2-4aed-9328-58c82b2e661c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.592866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff9c8-aef2-4aed-9328-58c82b2e661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.648429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ce0ff9c8-aef2-4aed-9328-58c82b2e661c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:04.652481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ce0ff9c8-aef2-4aed-9328-58c82b2e661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.743184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9df4a-d94e-4492-bc96-67b94419146f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.756625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.757278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 862/1708] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:04.757531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.757997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.758357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.759473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0767-bbc9-4631-b233-a73be8c1cdf1 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.759908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0767-bbc9-4631-b233-a73be8c1cdf1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.760412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0767-bbc9-4631-b233-a73be8c1cdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.765626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.784429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-549b0767-bbc9-4631-b233-a73be8c1cdf1 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:04.786232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-549b0767-bbc9-4631-b233-a73be8c1cdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.796732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 863/1709] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:04.798525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e560-3774-4d89-a320-796fb10bc9d7 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.798960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e560-3774-4d89-a320-796fb10bc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.799377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e560-3774-4d89-a320-796fb10bc9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.805636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.810576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.825664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0fe2e560-3774-4d89-a320-796fb10bc9d7 None None] MFA Rules not processed for user `7dd2273d28c14633bd62e590171dac31`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:04.827538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0fe2e560-3774-4d89-a320-796fb10bc9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:04.840672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 847/1710] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:04.842195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.863625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dc284-1554-4dbe-8ddf-ea991f3e68fd service placement] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.876304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.877659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.877937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.878211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.880003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.887207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.944788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 848/1711] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:04.947191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.959410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275bca-e706-49fb-821c-f40fcc7cf42b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:04.964198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:04.964847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:04.965122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:04.965389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:04.966041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:04.967814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:04.981836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 849/1712] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:04.982861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.984876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 864/1713] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:04.986171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e560-3774-4d89-a320-796fb10bc9d7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:04.996099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c510-a2c7-44ed-96e6-57c8e7778f74 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.001987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.002652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.002931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.003199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.004736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:05.004736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.006452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.024100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 850/1714] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:05.024100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.035479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9d3-d339-40ff-9a89-bed28d8ae01c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.037330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e560-3774-4d89-a320-796fb10bc9d7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.051070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.053163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.053453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.053724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.054636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:05.054728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.056288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.079483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 865/1715] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:05.080654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.089777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.090414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.090691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.090960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.091611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.093962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1382c-fd4e-4582-b344-c0a8d2933c30 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.100541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.101234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.106971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.107309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] PATH_INFO: `/v3/projects/652185c7344542fa89d4ca4e3d6dacc6/users/c9543dd6a23a42bcb15269b8c48cb9ac/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.118729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.138589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652185c7344542fa89d4ca4e3d6dacc6, user_id=c9543dd6a23a42bcb15269b8c48cb9ac, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.141866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.171896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 866/1716] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:05 2022] PUT /identity/v3/projects/652185c7344542fa89d4ca4e3d6dacc6/users/c9543dd6a23a42bcb15269b8c48cb9ac/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:05.174485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.191075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 851/1717] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:05.191999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.222499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005bfe8-6a3c-4160-b9ab-f0263229f584 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.314692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:05.340333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:05.367916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174241b-8cec-4849-91d7-8f28932bf334 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.381117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.381756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.382037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.382312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.383007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.389559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.427850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.428531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.429109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.429658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.430091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.442244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.475063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 867/1718] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:05 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:05.476046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.542605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 852/1719] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:05 2022] POST /identity/v3/projects => generated 381 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:05.542605 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.621960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f123d4-683b-4777-adb3-01af35004020 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.749089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7d334-ffa1-4ca0-a55b-4b25a31efb96 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.781173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.781703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.782109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.782235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.782903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.784558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.796865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.797730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.798018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.798303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.798954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.802161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.812531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 853/1720] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:05.813485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.840716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 868/1721] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:05.841957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.845327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcad692-4ae3-49a3-943e-2d55e4e55946 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.865446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b5a3e-2838-402c-8d4c-bcb32e0cf8ed admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.870833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.871472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.871744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.878231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.878442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.878942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.879066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.879346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.879618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:05.883898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.886816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:05.895098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:05.951559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 869/1722] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:05 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:05.951559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.966675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 854/1723] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:05 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:05.974754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092db65-da5f-4476-b986-173a612ad3e5 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:05.975863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:05.996444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:05.997169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:05.997440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:05.997712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] PATH_INFO: `/v3/projects/ff8de15499354e06b2c23514339892e8/users/7f592e08bf1f4658ad178ed917462022/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.026801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8de15499354e06b2c23514339892e8, user_id=7f592e08bf1f4658ad178ed917462022, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:06.029550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:06.045969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a561-08e8-4d15-a7bf-aca451a1ad48 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:06.065748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:06.066414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 870/1724] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:05 2022] PUT /identity/v3/projects/ff8de15499354e06b2c23514339892e8/users/7f592e08bf1f4658ad178ed917462022/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:06.066536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.066719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.067000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] PATH_INFO: `/v3/projects/652185c7344542fa89d4ca4e3d6dacc6/users/c9543dd6a23a42bcb15269b8c48cb9ac/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.067398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:06.082008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652185c7344542fa89d4ca4e3d6dacc6, user_id=c9543dd6a23a42bcb15269b8c48cb9ac, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:06.109412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:06.160073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 855/1725] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:05 2022] PUT /identity/v3/projects/652185c7344542fa89d4ca4e3d6dacc6/users/c9543dd6a23a42bcb15269b8c48cb9ac/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:06.166609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:06.181450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:06.226414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682efef2-a838-46f6-8f04-eef8cf69a985 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:06.385652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e2cec-94aa-421e-abeb-e8d2d8407702 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:06.392697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9181d-0fa7-4ac6-81f8-d3ee79b4f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:06.393345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9181d-0fa7-4ac6-81f8-d3ee79b4f117 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.393626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9181d-0fa7-4ac6-81f8-d3ee79b4f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.393900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9181d-0fa7-4ac6-81f8-d3ee79b4f117 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.394569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9181d-0fa7-4ac6-81f8-d3ee79b4f117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:06.398129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9181d-0fa7-4ac6-81f8-d3ee79b4f117 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:06.413145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35871-3d5e-4a30-8ce2-9ccb68c1210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:06.413794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35871-3d5e-4a30-8ce2-9ccb68c1210e admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.414071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35871-3d5e-4a30-8ce2-9ccb68c1210e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.414342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35871-3d5e-4a30-8ce2-9ccb68c1210e admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.415384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35871-3d5e-4a30-8ce2-9ccb68c1210e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:06.419107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 871/1726] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:06.420525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ebf3d-7488-46b1-866c-26694fa5fc64 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.420811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ebf3d-7488-46b1-866c-26694fa5fc64 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.421083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ebf3d-7488-46b1-866c-26694fa5fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.424357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35871-3d5e-4a30-8ce2-9ccb68c1210e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:06.456133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 856/1727] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:06.457835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c8e3-b1fd-4a15-b489-fad9d9853049 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.459594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c8e3-b1fd-4a15-b489-fad9d9853049 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.459892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c8e3-b1fd-4a15-b489-fad9d9853049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.518898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a77ebf3d-7488-46b1-866c-26694fa5fc64 None None] MFA Rules not processed for user `7f592e08bf1f4658ad178ed917462022`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:06.531942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a77ebf3d-7488-46b1-866c-26694fa5fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:06.558029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0e13c8e3-b1fd-4a15-b489-fad9d9853049 None None] MFA Rules not processed for user `c9543dd6a23a42bcb15269b8c48cb9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:06.559272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0e13c8e3-b1fd-4a15-b489-fad9d9853049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:06.577376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:06.703505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 872/1728] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:06.707698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ebf3d-7488-46b1-866c-26694fa5fc64 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:06.739102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ebf3d-7488-46b1-866c-26694fa5fc64 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:06.753204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:06.754113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.754197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.754614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.760628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:06.765918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:06.817279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 873/1729] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:06.821768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:06.828526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 857/1730] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:06.829399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c8e3-b1fd-4a15-b489-fad9d9853049 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:06.848421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c8e3-b1fd-4a15-b489-fad9d9853049 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:06.860164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:06.860904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.861169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.861420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.869369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:06.886877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ba18c-79bf-4731-921d-7058d3343c2b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:06.891324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:06.910427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:06.911063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:06.911384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:06.916230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:06.916984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:06.922060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:06.990051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 874/1731] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:06.993060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:07.011670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 858/1732] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:06 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:07.017931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:07.018391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb3d-3623-4ac1-92d2-275c4d9a6f9b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:07.022005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:07.122060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:07.170701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:07.173854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:07.173961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:07.174221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] PATH_INFO: `/v3/projects/f03ef7963ef34868865bd7f919a53fe4/users/0c18871eb7e04294a1b8d67e8a98b9a3/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:07.216918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03ef7963ef34868865bd7f919a53fe4, user_id=0c18871eb7e04294a1b8d67e8a98b9a3, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:07.222761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:07.224398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa43098-df70-4850-b328-d76875bd965f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:07.234114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:07.235189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:07.235609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:07.237232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:07.260801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 875/1733] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:06 2022] PUT /identity/v3/projects/f03ef7963ef34868865bd7f919a53fe4/users/0c18871eb7e04294a1b8d67e8a98b9a3/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:07.261729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:07.418882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:07.423758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:07.453276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 859/1734] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:07.454854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:07.484145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a7322-0a79-4bf5-ada7-16b7e1b04137 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:07.502619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a55488-68e1-4291-a09a-c8b91311230a service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:07.517462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:07.518021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:07.518299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:07.518645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] PATH_INFO: `/v3/projects/e5d06815d92c4334a9561c1446fc79d8/users/9603f07de1e54a6a9e7e18bde63e9bbd/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:07.532348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf70ce-371d-44d9-b1a4-6e947549879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:07.533907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf70ce-371d-44d9-b1a4-6e947549879d admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:07.533907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf70ce-371d-44d9-b1a4-6e947549879d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:07.533907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf70ce-371d-44d9-b1a4-6e947549879d admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:07.534586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf70ce-371d-44d9-b1a4-6e947549879d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:07.539221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf70ce-371d-44d9-b1a4-6e947549879d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:07.587334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d06815d92c4334a9561c1446fc79d8, user_id=9603f07de1e54a6a9e7e18bde63e9bbd, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:07.591160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:07.600502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 860/1735] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:07 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:07.602252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c7d9-a123-4ee6-a046-a2fc6c9b26bd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:07.604813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c7d9-a123-4ee6-a046-a2fc6c9b26bd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:07.605168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c7d9-a123-4ee6-a046-a2fc6c9b26bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:07.640264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 876/1736] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:07 2022] PUT /identity/v3/projects/e5d06815d92c4334a9561c1446fc79d8/users/9603f07de1e54a6a9e7e18bde63e9bbd/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:07.643672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:07.655889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:07.659026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:07.674349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4336c7d9-a123-4ee6-a046-a2fc6c9b26bd None None] MFA Rules not processed for user `0c18871eb7e04294a1b8d67e8a98b9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:07.675971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4336c7d9-a123-4ee6-a046-a2fc6c9b26bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:07.827207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de90ea2-5b70-4618-8803-eec0c66e4c9e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:07.843793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d22d4f-92ec-4dd4-8d56-93e5099dc05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:07.843793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22d4f-92ec-4dd4-8d56-93e5099dc05c service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:07.843793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22d4f-92ec-4dd4-8d56-93e5099dc05c service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:07.843793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22d4f-92ec-4dd4-8d56-93e5099dc05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:07.848324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-60d22d4f-92ec-4dd4-8d56-93e5099dc05c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:07.924070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 861/1737] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:07.929025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336c7d9-a123-4ee6-a046-a2fc6c9b26bd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:08.105815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d22d4f-92ec-4dd4-8d56-93e5099dc05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:08.107904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d22d4f-92ec-4dd4-8d56-93e5099dc05c service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:08.134076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 877/1738] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:08.140871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000d80-c07d-409a-96b0-00e7ab81263e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.141281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000d80-c07d-409a-96b0-00e7ab81263e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.141655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000d80-c07d-409a-96b0-00e7ab81263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.176555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336c7d9-a123-4ee6-a046-a2fc6c9b26bd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:08.199654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:08.203106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dd009-db02-4220-b7d6-521113730586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:08.203941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd009-db02-4220-b7d6-521113730586 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.204229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd009-db02-4220-b7d6-521113730586 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.205516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd009-db02-4220-b7d6-521113730586 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.206089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dd009-db02-4220-b7d6-521113730586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:08.207746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dd009-db02-4220-b7d6-521113730586 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:08.274719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-48000d80-c07d-409a-96b0-00e7ab81263e None None] MFA Rules not processed for user `9603f07de1e54a6a9e7e18bde63e9bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:08.277508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-48000d80-c07d-409a-96b0-00e7ab81263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:08.278087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 862/1739] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:08.282786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee640-1aa1-44a7-9ea3-69da878f13fa None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.283320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee640-1aa1-44a7-9ea3-69da878f13fa None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.283848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee640-1aa1-44a7-9ea3-69da878f13fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.342538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2f4ee640-1aa1-44a7-9ea3-69da878f13fa None None] MFA Rules not processed for user `888e94e8319147fe8bf9b3f80dfd8bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:08.343874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2f4ee640-1aa1-44a7-9ea3-69da878f13fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:08.462452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 863/1740] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:08.463650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee640-1aa1-44a7-9ea3-69da878f13fa None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:08.492536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee640-1aa1-44a7-9ea3-69da878f13fa None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:08.505094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 878/1741] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:08.505094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000d80-c07d-409a-96b0-00e7ab81263e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:08.505388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfff36-516f-4d5a-97dd-a2c86eb5ccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:08.506608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfff36-516f-4d5a-97dd-a2c86eb5ccbe admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.509313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfff36-516f-4d5a-97dd-a2c86eb5ccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.509636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfff36-516f-4d5a-97dd-a2c86eb5ccbe admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.510350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfff36-516f-4d5a-97dd-a2c86eb5ccbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:08.512242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfff36-516f-4d5a-97dd-a2c86eb5ccbe admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:08.538487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000d80-c07d-409a-96b0-00e7ab81263e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:08.549548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:08.550240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.550675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.550954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] PATH_INFO: `/v3/projects/9cb5447e9b9442e18be60a8aca063429/users/a99269b8a5ad419696172c21047300db/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.593289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb5447e9b9442e18be60a8aca063429, user_id=a99269b8a5ad419696172c21047300db, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:08.600760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 864/1742] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:08 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:08.603267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9274-1f38-4c5c-9e69-0f8fbcf63e81 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.603267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9274-1f38-4c5c-9e69-0f8fbcf63e81 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.604204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9274-1f38-4c5c-9e69-0f8fbcf63e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.617071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:08.623254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:08.658989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 879/1743] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:08 2022] PUT /identity/v3/projects/9cb5447e9b9442e18be60a8aca063429/users/a99269b8a5ad419696172c21047300db/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:08.659901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:08.677981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-03ae9274-1f38-4c5c-9e69-0f8fbcf63e81 None None] MFA Rules not processed for user `888e94e8319147fe8bf9b3f80dfd8bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:08.681083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-03ae9274-1f38-4c5c-9e69-0f8fbcf63e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:08.778041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2802d4-571c-4768-8387-468b55301209 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:08.796859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:08.799289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.803607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.804478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.805268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:08.812395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:08.858003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 865/1744] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:08.860051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9274-1f38-4c5c-9e69-0f8fbcf63e81 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:08.891522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9274-1f38-4c5c-9e69-0f8fbcf63e81 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:08.908063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:08.909528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:08.909837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:08.910115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:08.913484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:08.913484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:08.916592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 880/1745] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:08 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:08.918834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:08.969479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 866/1746] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:08 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:08.970672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:08.979029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:09.096725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845603-bc29-4a4c-a704-8d69003b32e2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:09.107191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:09.108080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.108454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.108797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.109507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:09.114830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:09.118549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:09.140750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 881/1747] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:09.142133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:09.156402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be19f5e-cd1b-4538-9fca-f15d6c651b07 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:09.176228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:09.177426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.177711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.177985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.178629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:09.180598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:09.195325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88805b3f-53bd-46d0-b8eb-20fa5ff5fa96 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:09.246032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 882/1748] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:09 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:09.247402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:09.265838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b6a6e-f6de-4943-93aa-3082078e20d2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:09.271768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49134d-f9fb-4c1f-b95c-be772f35ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:09.272469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49134d-f9fb-4c1f-b95c-be772f35ee77 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.272757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49134d-f9fb-4c1f-b95c-be772f35ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.273035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49134d-f9fb-4c1f-b95c-be772f35ee77 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.273720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49134d-f9fb-4c1f-b95c-be772f35ee77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:09.275325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49134d-f9fb-4c1f-b95c-be772f35ee77 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:09.290938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 883/1749] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:09.292296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bd111-0689-4b61-a906-251de6b820c2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.292613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bd111-0689-4b61-a906-251de6b820c2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.292888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bd111-0689-4b61-a906-251de6b820c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.337034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-709bd111-0689-4b61-a906-251de6b820c2 None None] MFA Rules not processed for user `77cdd85bff5d4911b351f34b2e13c5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:09.338275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-709bd111-0689-4b61-a906-251de6b820c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:09.444080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:09.445697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.445819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.450759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.512993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:09.569271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:09.580429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 884/1750] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:09.580429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bd111-0689-4b61-a906-251de6b820c2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:09.580694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:09.602787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 867/1751] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:09.603496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bd111-0689-4b61-a906-251de6b820c2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:09.617151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:09.618114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.618583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.619006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] PATH_INFO: `/v3/projects/9cb5447e9b9442e18be60a8aca063429/users/a99269b8a5ad419696172c21047300db/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.621209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:09.622589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb5447e9b9442e18be60a8aca063429, user_id=a99269b8a5ad419696172c21047300db, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:09.625807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:09.657585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 885/1752] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:09 2022] PUT /identity/v3/projects/9cb5447e9b9442e18be60a8aca063429/users/a99269b8a5ad419696172c21047300db/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:09.658705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:09.671823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54275707-1073-45e8-aea2-71b5954c146f service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:09.829932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3740f-75b3-46df-9e15-3bc22442cdb8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:09.871258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3c3e7-ffb9-4cac-a2fe-95c35805354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:09.872050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c3e7-ffb9-4cac-a2fe-95c35805354a admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.872469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c3e7-ffb9-4cac-a2fe-95c35805354a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.872863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c3e7-ffb9-4cac-a2fe-95c35805354a admin admin] PATH_INFO: `/v3/projects/32fa23a683614aa1b7a3d38dfd8f748c/users/ba1a95ac990242db95a54a74e1a12ea6/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.885300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:09.887521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.891471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.891779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.897564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:09.904622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3c3e7-ffb9-4cac-a2fe-95c35805354a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fa23a683614aa1b7a3d38dfd8f748c, user_id=ba1a95ac990242db95a54a74e1a12ea6, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:09.905221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:09.907533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3c3e7-ffb9-4cac-a2fe-95c35805354a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:09.935582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 886/1753] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:09 2022] PUT /identity/v3/projects/32fa23a683614aa1b7a3d38dfd8f748c/users/ba1a95ac990242db95a54a74e1a12ea6/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:09.937306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd9ecc-b010-4a13-b9eb-ebd7ede0cb00 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:09.940763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd9ecc-b010-4a13-b9eb-ebd7ede0cb00 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:09.941166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd9ecc-b010-4a13-b9eb-ebd7ede0cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:09.956360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 868/1754] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:09.961806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:09.995752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aebf20-7a2d-4c42-8223-49babf708d30 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:10.006500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-36bd9ecc-b010-4a13-b9eb-ebd7ede0cb00 None None] MFA Rules not processed for user `a99269b8a5ad419696172c21047300db`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:10.008006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-36bd9ecc-b010-4a13-b9eb-ebd7ede0cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:10.041745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:10.172905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:10.174001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:10.174488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:10.175017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:10.176192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:10.177282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 887/1755] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:10.178272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd9ecc-b010-4a13-b9eb-ebd7ede0cb00 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:10.178926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:10.191244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd9ecc-b010-4a13-b9eb-ebd7ede0cb00 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:10.196913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:10.197607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:10.197952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:10.198293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:10.199024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:10.200941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:10.214599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 869/1756] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:10.215660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:10.234284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 888/1757] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:10.235120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:10.260131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e74b3-e996-42ec-975e-a5193162123c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:10.269367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:10.276321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:10.276931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:10.278669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] PATH_INFO: `/v3/projects/32fa23a683614aa1b7a3d38dfd8f748c/users/ba1a95ac990242db95a54a74e1a12ea6/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:10.288294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fa23a683614aa1b7a3d38dfd8f748c, user_id=ba1a95ac990242db95a54a74e1a12ea6, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:10.297262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:10.341932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 889/1758] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:10 2022] PUT /identity/v3/projects/32fa23a683614aa1b7a3d38dfd8f748c/users/ba1a95ac990242db95a54a74e1a12ea6/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:10.342913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:10.357688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b300e9-06d7-4cad-bc8a-1209342e9f4f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:10.406398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:10.493555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd1176-4ead-4c35-8220-0aaa2c61dfea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:10.494725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd1176-4ead-4c35-8220-0aaa2c61dfea service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:10.495184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd1176-4ead-4c35-8220-0aaa2c61dfea service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:10.495686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd1176-4ead-4c35-8220-0aaa2c61dfea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:10.501038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea76a1a-b4ea-46f1-bd74-3d75ff87d251 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:10.510519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04370b-0388-4c9b-a417-d9b23c1a2a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:10.511241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04370b-0388-4c9b-a417-d9b23c1a2a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:10.511511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04370b-0388-4c9b-a417-d9b23c1a2a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:10.511798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04370b-0388-4c9b-a417-d9b23c1a2a90 admin admin] PATH_INFO: `/v3/projects/42fa8996d6734ae68e273d21dd9a1a93/users/4ccbc5a491994e5391ad171d2d272181/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:10.558818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04370b-0388-4c9b-a417-d9b23c1a2a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fa8996d6734ae68e273d21dd9a1a93, user_id=4ccbc5a491994e5391ad171d2d272181, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:10.562283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04370b-0388-4c9b-a417-d9b23c1a2a90 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:10.593666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 890/1759] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:10 2022] PUT /identity/v3/projects/42fa8996d6734ae68e273d21dd9a1a93/users/4ccbc5a491994e5391ad171d2d272181/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:10.595001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:10.595291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:10.595562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:10.718219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd1176-4ead-4c35-8220-0aaa2c61dfea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:10.718504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd1176-4ead-4c35-8220-0aaa2c61dfea service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:10.723324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:10.724015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:10.737650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 870/1760] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:10.738600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef4015-7aea-4d4d-a354-d629b7ba46c8 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:10.738893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef4015-7aea-4d4d-a354-d629b7ba46c8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:10.739142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef4015-7aea-4d4d-a354-d629b7ba46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:10.812271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0bef4015-7aea-4d4d-a354-d629b7ba46c8 None None] MFA Rules not processed for user `ba1a95ac990242db95a54a74e1a12ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:10.813627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0bef4015-7aea-4d4d-a354-d629b7ba46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:10.831564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:10.905475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 891/1761] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:30:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:10.906345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:10.909845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:11.060653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 871/1762] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:11.064735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a4f0-bf8e-4820-8c5c-491555ac6bc4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:11.065136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a4f0-bf8e-4820-8c5c-491555ac6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:11.065511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a4f0-bf8e-4820-8c5c-491555ac6bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:11.142015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19363e-b1ea-42b4-a3d0-db97c19f591b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:11.148687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6577a4f0-bf8e-4820-8c5c-491555ac6bc4 None None] MFA Rules not processed for user `4ccbc5a491994e5391ad171d2d272181`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:11.153656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6577a4f0-bf8e-4820-8c5c-491555ac6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:11.155020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:11.157256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:11.158312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:11.159017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:11.284607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:11.314885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:11.317547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:11.347384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 892/1763] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:11.354388 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:11.355569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 872/1764] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:11.356483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577a4f0-bf8e-4820-8c5c-491555ac6bc4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:11.554255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ee7f3-66bd-4871-b60d-90e652e1fe32 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:11.564710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577a4f0-bf8e-4820-8c5c-491555ac6bc4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:11.567841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:11.569881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:11.570160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:11.570430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:11.573476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:11.576051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:11.576606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:11.576887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:11.637263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:11.639745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:11.693063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 873/1765] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:11.693984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:11.696348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:11.714479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:11.766599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:11.768161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:11.790793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 893/1766] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:11.791979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:11.946272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d0fd-2bc7-4012-80e3-20239b40880d service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:11.965292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:11.965921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:11.966226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:11.966668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:11.967300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:11.969332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:12.010157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529ad4-1b95-4591-9fc9-d609df3927f4 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:12.037127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 894/1767] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:11 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:12.038019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:12.053708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:12.054346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:12.059879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:12.061446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:12.105202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:12.111595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:12.155648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 874/1768] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:30:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:30:12.276301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738161f-6d52-4559-8e6d-7e0fea1c4f6e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:12.310361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:12.311002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:12.311283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:12.311888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:12.313989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:12.335268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:12.429381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:12.440274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 895/1769] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:12 2022] POST /identity/v3/users => generated 300 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:12.457285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93e77-8904-4d18-a3e3-be3ea21ae4ae service swift] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:12.475833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:12.476583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:12.476932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:12.477431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:12.478118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:12.485615 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:12.511708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:12.516710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 875/1770] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:12.541051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b84ed-8111-4648-ae9d-124d815fd664 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:12.594213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:12.596257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:12.596257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:12.596257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] PATH_INFO: `/v3/projects/430a1991f038425b8211d1e71dc5c165/users/c5681a5f2e394f2daadc811dea696464/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:12.697030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=430a1991f038425b8211d1e71dc5c165, user_id=c5681a5f2e394f2daadc811dea696464, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:12.702194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:12.742373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 896/1771] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:12 2022] PUT /identity/v3/projects/430a1991f038425b8211d1e71dc5c165/users/c5681a5f2e394f2daadc811dea696464/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:12.746443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:12.771694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc438e-d9a4-4553-9ed3-162c5feeeca1 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:12.951433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:13.035782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e56e93-52a1-472a-b785-09605af4d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:13.039384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e56e93-52a1-472a-b785-09605af4d8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:13.041852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e56e93-52a1-472a-b785-09605af4d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:13.042929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e56e93-52a1-472a-b785-09605af4d8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:13.046592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e56e93-52a1-472a-b785-09605af4d8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:13.055519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e56e93-52a1-472a-b785-09605af4d8a0 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:13.097902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 876/1772] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:13.101482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:13.123952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388898a3-be1b-490a-a133-0fff077ade3f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:13.144420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:13.145226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:13.146260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:13.146260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] PATH_INFO: `/v3/projects/430a1991f038425b8211d1e71dc5c165/users/c5681a5f2e394f2daadc811dea696464/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:13.149635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=430a1991f038425b8211d1e71dc5c165, user_id=c5681a5f2e394f2daadc811dea696464, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:13.160915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:13.219017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 897/1773] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:13 2022] PUT /identity/v3/projects/430a1991f038425b8211d1e71dc5c165/users/c5681a5f2e394f2daadc811dea696464/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:13.230671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687949-4a8d-4fee-81b6-b06eadab9951 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:13.230954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687949-4a8d-4fee-81b6-b06eadab9951 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:13.231248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687949-4a8d-4fee-81b6-b06eadab9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:13.328849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:13.374505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-9e687949-4a8d-4fee-81b6-b06eadab9951 None None] MFA Rules not processed for user `c5681a5f2e394f2daadc811dea696464`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:13.377427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9e687949-4a8d-4fee-81b6-b06eadab9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:13.378449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:13.717717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aa2fc-cb57-430e-aa55-ac0874fe2dac admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:13.756697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:13.757771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:13.759921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:13.760299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] PATH_INFO: `/v3/users/0c18871eb7e04294a1b8d67e8a98b9a3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:13.764575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c18871eb7e04294a1b8d67e8a98b9a3)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:13.784695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:13.847152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 877/1774] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 618 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:13.857241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515982d-785f-4e23-bf48-68eed4736eaf None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:13.857502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515982d-785f-4e23-bf48-68eed4736eaf None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:13.857772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515982d-785f-4e23-bf48-68eed4736eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:14.017250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1515982d-785f-4e23-bf48-68eed4736eaf None None] MFA Rules not processed for user `baa7f3487b674e75afe5fca74db44807`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:14.030456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1515982d-785f-4e23-bf48-68eed4736eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:14.084926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c18871eb7e04294a1b8d67e8a98b9a3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:14.106555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c18871eb7e04294a1b8d67e8a98b9a3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:14.108753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c18871eb7e04294a1b8d67e8a98b9a3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:14.125781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c18871eb7e04294a1b8d67e8a98b9a3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:14.158931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c18871eb7e04294a1b8d67e8a98b9a3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:14.177967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 898/1775] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:13 2022] DELETE /identity/v3/users/0c18871eb7e04294a1b8d67e8a98b9a3 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:14.180265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:14.183358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:14.386169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f9039-73f2-48a5-9570-6dab7a57d4e9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:14.405947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:14.411065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:14.412581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:14.412865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:14.422640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:14.493086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 878/1776] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Sep 1 00:30:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 645 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:14.501579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:14.502146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:14.502870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:14.588735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:14.591253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:14.676803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:14.764372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:14.766016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:14.841096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 899/1777] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:14.842961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:14.852141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:14.879427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 879/1778] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:14.883933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:14.891399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:14.964985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4e970-4baf-4dbf-a8ec-4e64765c176f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:14.988080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:14.990924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:14.996129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:14.996647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] PATH_INFO: `/v3/users/e9817b9fc093493db3211f5ea1fa4af4` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:15.001743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9817b9fc093493db3211f5ea1fa4af4)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:15.009891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:15.034587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:15.136871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe3c07-a488-41db-a5e9-cb580d7c9fa2 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:15.165968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:15.169482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:15.170778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:15.171073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:15.194174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:15.202350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:15.241676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 900/1779] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:15.242640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:15.252197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:15.320887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1158-69b5-4334-bf7d-d1b1cc109513 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:15.333572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054c42d-992d-4e33-a613-5c5633fdf80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:15.338352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054c42d-992d-4e33-a613-5c5633fdf80a service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:15.338644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054c42d-992d-4e33-a613-5c5633fdf80a service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:15.338916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054c42d-992d-4e33-a613-5c5633fdf80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:15.350603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9817b9fc093493db3211f5ea1fa4af4'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:15.377274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054c42d-992d-4e33-a613-5c5633fdf80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:15.386108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054c42d-992d-4e33-a613-5c5633fdf80a service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:15.406887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9817b9fc093493db3211f5ea1fa4af4'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:15.433125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 901/1780] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:15.468218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9817b9fc093493db3211f5ea1fa4af4'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:15.472081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9817b9fc093493db3211f5ea1fa4af4'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:15.474107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9817b9fc093493db3211f5ea1fa4af4'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:15.606929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 880/1781] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:14 2022] DELETE /identity/v3/users/e9817b9fc093493db3211f5ea1fa4af4 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:15.611573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:15.612176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:15.612676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:15.664015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:15.668781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:15.827929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 902/1782] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:15.890898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:15.894069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:16.077903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bae010-01ed-41ff-9491-d79040365ce1 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:16.109435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:16.110495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:16.110804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:16.111076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:16.205263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:16.209874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:16.243609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 881/1783] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:16.458618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:16.460608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:16.612646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572c6bd-8a29-4f24-811b-eb0bd8970cb6 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:16.624522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75325ca9-440c-410e-8cf3-cd12350ccefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:16.625322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325ca9-440c-410e-8cf3-cd12350ccefd service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:16.625586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325ca9-440c-410e-8cf3-cd12350ccefd service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:16.625859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325ca9-440c-410e-8cf3-cd12350ccefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:16.630287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-75325ca9-440c-410e-8cf3-cd12350ccefd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:16.732484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:16.847595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75325ca9-440c-410e-8cf3-cd12350ccefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:16.854630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75325ca9-440c-410e-8cf3-cd12350ccefd service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:16.907671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 903/1784] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:17.151251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:17.153621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:17.201550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4be333-5764-4e06-9973-f76bbd3c4a4d service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:17.223248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:17.224012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:17.224294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:17.224656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] PATH_INFO: `/v3/users/7f592e08bf1f4658ad178ed917462022` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:17.231165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f592e08bf1f4658ad178ed917462022)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:17.237844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:17.379088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f592e08bf1f4658ad178ed917462022'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:17.388029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f592e08bf1f4658ad178ed917462022'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:17.403656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f592e08bf1f4658ad178ed917462022'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:17.406293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f592e08bf1f4658ad178ed917462022'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:17.407048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f592e08bf1f4658ad178ed917462022'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:17.444817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:17.459097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 882/1785] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:17 2022] DELETE /identity/v3/users/7f592e08bf1f4658ad178ed917462022 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:17.464636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:17.465312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:17.465856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:17.503088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:17.506238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:17.693877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 904/1786] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:17.845493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:17.846991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:18.043929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351da07-67d0-481b-9b99-23c7d93030b4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:18.067792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:18.070074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:18.073558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:18.074210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:18.107324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:18.112588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:18.149825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 883/1787] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:18.234426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:18.236255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:18.264894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773930f-5a28-4ca5-adef-81d0f1c53aa1 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:18.275755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:18.276933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:18.278306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:18.279285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] PATH_INFO: `/v3/projects/f03ef7963ef34868865bd7f919a53fe4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:18.282971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03ef7963ef34868865bd7f919a53fe4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:18.291254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:18.433964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03ef7963ef34868865bd7f919a53fe4', 'request_id': 'req-1776df42-38ed-499e-ad11-309a9ba72ea5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.454070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03ef7963ef34868865bd7f919a53fe4', 'request_id': 'req-1776df42-38ed-499e-ad11-309a9ba72ea5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.472404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03ef7963ef34868865bd7f919a53fe4', 'request_id': 'req-1776df42-38ed-499e-ad11-309a9ba72ea5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.517020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] The token cache is being invalidate because project f03ef7963ef34868865bd7f919a53fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:18.519186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.522723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1776df42-38ed-499e-ad11-309a9ba72ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.532906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 905/1788] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:18 2022] DELETE /identity/v3/projects/f03ef7963ef34868865bd7f919a53fe4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:18.537661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:18.553439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a965-413a-4e2e-b2f6-d39e6472cfaf service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:18.767847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:18.769261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:18.769261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:18.769261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] PATH_INFO: `/v3/users/ba1a95ac990242db95a54a74e1a12ea6` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:18.773378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1a95ac990242db95a54a74e1a12ea6)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:18.775813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:18.903947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1a95ac990242db95a54a74e1a12ea6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.931326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1a95ac990242db95a54a74e1a12ea6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.950406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1a95ac990242db95a54a74e1a12ea6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.952724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1a95ac990242db95a54a74e1a12ea6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:18.954518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-85d33ff4-5429-4201-9bbf-64e37c86d460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1a95ac990242db95a54a74e1a12ea6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:19.032036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 884/1789] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:18 2022] DELETE /identity/v3/users/ba1a95ac990242db95a54a74e1a12ea6 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:19.812186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b57e16-94cf-4d2c-9be6-8c88de45d28b None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:19.813151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b57e16-94cf-4d2c-9be6-8c88de45d28b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:19.813667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b57e16-94cf-4d2c-9be6-8c88de45d28b None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:19.815768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 906/1790] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:30:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:30:19.899034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:19.899651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:19.900296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:19.941433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:19.943398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:19.992148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:20.134528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 885/1791] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:30:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:20.337941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b57e16-94cf-4d2c-9be6-8c88de45d28b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:20.345599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-63b57e16-94cf-4d2c-9be6-8c88de45d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:20.443737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:20.445486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:20.499709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f7e71-b9fe-4d41-902f-0fda9e1b4b67 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:20.517709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:20.533188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:20.534049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:20.534512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:20.534897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:20.574194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:20.576096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:20.586007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b57e16-94cf-4d2c-9be6-8c88de45d28b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:20.605630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:20.606773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:20.608484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:20.608935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] PATH_INFO: `/v3/projects/d428d978710e4d8da8e31137a4f699c3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:20.614392 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=d428d978710e4d8da8e31137a4f699c3)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:20.622997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:20.643837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 886/1792] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:20.759665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:20.761410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:20.815315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d39f7b-c395-4d8e-9685-0f2d97311210 service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:20.840136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd428d978710e4d8da8e31137a4f699c3', 'request_id': 'req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:20.875576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd428d978710e4d8da8e31137a4f699c3', 'request_id': 'req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:20.908434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd428d978710e4d8da8e31137a4f699c3', 'request_id': 'req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:20.971637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] The token cache is being invalidate because project d428d978710e4d8da8e31137a4f699c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:20.972059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:20.972768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:20.978453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 907/1793] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:20 2022] DELETE /identity/v3/projects/d428d978710e4d8da8e31137a4f699c3 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:20.990468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:20.995202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:21.035129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:21.035875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:21.036621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:21.041316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] PATH_INFO: `/v3/projects/ff8de15499354e06b2c23514339892e8` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:21.043245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8de15499354e06b2c23514339892e8)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:21.047838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:21.223846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8de15499354e06b2c23514339892e8', 'request_id': 'req-b12ea618-e047-42d1-a15e-f0a035bd138a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.241626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8de15499354e06b2c23514339892e8', 'request_id': 'req-b12ea618-e047-42d1-a15e-f0a035bd138a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.253375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbe7ab-82a2-4caa-9886-1ed9a1946bde admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:21.261015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8de15499354e06b2c23514339892e8', 'request_id': 'req-b12ea618-e047-42d1-a15e-f0a035bd138a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.299760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] The token cache is being invalidate because project ff8de15499354e06b2c23514339892e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:21.300062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.303829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b12ea618-e047-42d1-a15e-f0a035bd138a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.312084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 887/1794] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:20 2022] DELETE /identity/v3/projects/ff8de15499354e06b2c23514339892e8 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:21.312084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494b44-85ac-4662-a735-23a598a1a0f0 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:21.312084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494b44-85ac-4662-a735-23a598a1a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:21.312084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494b44-85ac-4662-a735-23a598a1a0f0 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:21.319530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 888/1795] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:30:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:30:21.320570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494b44-85ac-4662-a735-23a598a1a0f0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:21.326003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3c494b44-85ac-4662-a735-23a598a1a0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:21.450967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:21.519087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494b44-85ac-4662-a735-23a598a1a0f0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:21.529504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:21.530156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:21.534430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:21.534747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] PATH_INFO: `/v3/users/a99269b8a5ad419696172c21047300db` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:21.536941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99269b8a5ad419696172c21047300db)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:21.537173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:21.541919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:21.559262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:21.562180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:21.562646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] PATH_INFO: `/v3/users/c9543dd6a23a42bcb15269b8c48cb9ac` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:21.564246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9543dd6a23a42bcb15269b8c48cb9ac)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:21.572749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:21.666409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99269b8a5ad419696172c21047300db'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.691696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99269b8a5ad419696172c21047300db'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.702977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:21.713761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99269b8a5ad419696172c21047300db'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.717126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99269b8a5ad419696172c21047300db'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.724836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3406b298-db14-483a-8e86-dc2f82c8f470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99269b8a5ad419696172c21047300db'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.757426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9543dd6a23a42bcb15269b8c48cb9ac'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.786569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9543dd6a23a42bcb15269b8c48cb9ac'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.787566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9543dd6a23a42bcb15269b8c48cb9ac'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.801578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 889/1796] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:21 2022] DELETE /identity/v3/users/a99269b8a5ad419696172c21047300db => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:21.801778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9543dd6a23a42bcb15269b8c48cb9ac'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.801877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab80fa3-3d4b-4922-a903-fe361ecff928 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:21.801877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab80fa3-3d4b-4922-a903-fe361ecff928 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:21.801877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab80fa3-3d4b-4922-a903-fe361ecff928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:21.861216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9543dd6a23a42bcb15269b8c48cb9ac'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:21.875478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1ab80fa3-3d4b-4922-a903-fe361ecff928 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:21.878488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1ab80fa3-3d4b-4922-a903-fe361ecff928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:21.890986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 908/1797] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:20 2022] DELETE /identity/v3/users/c9543dd6a23a42bcb15269b8c48cb9ac => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:21.906857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:21.910728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:22.102147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 890/1798] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:22.154409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3290c9-81e9-41b1-a19b-a9330ce76688 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:22.169748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:22.170769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:22.171061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:22.171638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] PATH_INFO: `/v3/projects/32fa23a683614aa1b7a3d38dfd8f748c` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:22.175415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fa23a683614aa1b7a3d38dfd8f748c)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:22.181861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:22.305854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fa23a683614aa1b7a3d38dfd8f748c', 'request_id': 'req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:22.325153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fa23a683614aa1b7a3d38dfd8f748c', 'request_id': 'req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:22.346796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fa23a683614aa1b7a3d38dfd8f748c', 'request_id': 'req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:22.370465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] The token cache is being invalidate because project 32fa23a683614aa1b7a3d38dfd8f748c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:22.370756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:22.373003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:22.374331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 909/1799] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:21 2022] DELETE /identity/v3/projects/32fa23a683614aa1b7a3d38dfd8f748c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:22.382546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ba2d3-c367-4426-8d41-185a81e31271 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:22.383047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ba2d3-c367-4426-8d41-185a81e31271 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:22.383851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ba2d3-c367-4426-8d41-185a81e31271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:22.455015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b64ba2d3-c367-4426-8d41-185a81e31271 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:22.461609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b64ba2d3-c367-4426-8d41-185a81e31271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:22.615079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:22.654870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:22.656683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:22.746982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 891/1800] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:22.748653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec2e3-9e33-4b9b-b2b4-258268fe4dda None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:22.751549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec2e3-9e33-4b9b-b2b4-258268fe4dda None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:22.752014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec2e3-9e33-4b9b-b2b4-258268fe4dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:22.818292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:22.836442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5b9ec2e3-9e33-4b9b-b2b4-258268fe4dda None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:22.837752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5b9ec2e3-9e33-4b9b-b2b4-258268fe4dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:22.876866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 892/1801] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:22.877722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec2e3-9e33-4b9b-b2b4-258268fe4dda None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:22.905690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec2e3-9e33-4b9b-b2b4-258268fe4dda None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:22.929159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:22.929814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:22.938473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:22.938729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:22.939499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:22.939757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:22.941424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:22.957715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f8f2-38c3-4fb3-82a2-adc55e5e008d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:22.987327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:22.987959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:22.988236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:22.988587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:22.990885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:22.993473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 893/1802] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:22.995624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:22.999845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:23.022490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:23.024466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:23.064475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 910/1803] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:23.065438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:23.107014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b992c8-81d0-42b5-a4ce-5785619073fa service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:23.126545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:23.127194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:23.127469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:23.127743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:23.128416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:23.130367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:23.238583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc3b2-3266-4b7a-bae9-853e44de5d73 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:23.253343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 911/1804] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:23 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:23.253511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:23.253511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:23.253511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:23.253511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:23.255082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:23.256714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:23.417394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:23.418886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:23.447193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 894/1805] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:23.495375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25b1d8-5391-4271-89a5-28eaad623b73 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:23.508137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c814-662e-447b-951a-be77f425498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:23.518020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c814-662e-447b-951a-be77f425498e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:23.518318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c814-662e-447b-951a-be77f425498e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:23.518594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c814-662e-447b-951a-be77f425498e admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:23.519278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c814-662e-447b-951a-be77f425498e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:23.530248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c814-662e-447b-951a-be77f425498e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:23.624538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:23.624737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 912/1806] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:23 2022] POST /identity/v3/users => generated 291 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:23.644338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971f7e-78e7-40df-b886-5012e344519b service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:23.662841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c814-662e-447b-951a-be77f425498e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:23.664451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8747c814-662e-447b-951a-be77f425498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:23.668272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:23.668931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:23.669214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:23.673878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:23.675231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:23.679352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:23.689724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c814-662e-447b-951a-be77f425498e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:23.709104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:23.709764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:23.710040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:23.710314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] PATH_INFO: `/v3/projects/9cb5447e9b9442e18be60a8aca063429` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:23.711499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb5447e9b9442e18be60a8aca063429)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:23.713576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:23.733119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 895/1807] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:23.734341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:23.781796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30958cce-b443-4054-a978-caac7a6eae14 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:23.804498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:23.805981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:23.807030 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:23.808551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:23.811413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:23.821773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:23.828773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb5447e9b9442e18be60a8aca063429', 'request_id': 'req-18e37ea8-1e3f-4302-a313-4ceaa29505c1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:23.843725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb5447e9b9442e18be60a8aca063429', 'request_id': 'req-18e37ea8-1e3f-4302-a313-4ceaa29505c1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:23.855806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 896/1808] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:23.859975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:23.866335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb5447e9b9442e18be60a8aca063429', 'request_id': 'req-18e37ea8-1e3f-4302-a313-4ceaa29505c1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:23.889312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] The token cache is being invalidate because project 9cb5447e9b9442e18be60a8aca063429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:23.889606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:23.891099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-18e37ea8-1e3f-4302-a313-4ceaa29505c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:23.898452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 913/1809] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:23 2022] DELETE /identity/v3/projects/9cb5447e9b9442e18be60a8aca063429 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:23.898713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58447d-6dc8-4514-b4e8-5ff9868457c6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:23.900041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2332-6038-4fa6-8bf4-795e63c2c288 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:23.900348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2332-6038-4fa6-8bf4-795e63c2c288 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:23.900691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2332-6038-4fa6-8bf4-795e63c2c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:23.963951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cf7e2332-6038-4fa6-8bf4-795e63c2c288 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:23.965279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cf7e2332-6038-4fa6-8bf4-795e63c2c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:23.987457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:24.090832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:24.122857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701be0fc-04f2-45af-a5e4-5042e58fb36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:24.125674 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be0fc-04f2-45af-a5e4-5042e58fb36f admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:24.129011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be0fc-04f2-45af-a5e4-5042e58fb36f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:24.129470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be0fc-04f2-45af-a5e4-5042e58fb36f admin admin] PATH_INFO: `/v3/projects/91e432a4e3c34f5f8d9a864aa5cfbbd9/users/ca71fe047938482ab3f9c5e9f3e90418/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:24.183718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 914/1810] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:24.188111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f457c-64dd-4ea0-9b0d-d5d165f68c75 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:24.188479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f457c-64dd-4ea0-9b0d-d5d165f68c75 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:24.188908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f457c-64dd-4ea0-9b0d-d5d165f68c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:24.195630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701be0fc-04f2-45af-a5e4-5042e58fb36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e432a4e3c34f5f8d9a864aa5cfbbd9, user_id=ca71fe047938482ab3f9c5e9f3e90418, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:24.206406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701be0fc-04f2-45af-a5e4-5042e58fb36f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:24.252844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1b2f457c-64dd-4ea0-9b0d-d5d165f68c75 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:24.254561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1b2f457c-64dd-4ea0-9b0d-d5d165f68c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:24.259064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 897/1811] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:23 2022] PUT /identity/v3/projects/91e432a4e3c34f5f8d9a864aa5cfbbd9/users/ca71fe047938482ab3f9c5e9f3e90418/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:24.270960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c891-0c99-457f-ab1f-1ba72976a145 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:24.272275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c891-0c99-457f-ab1f-1ba72976a145 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:24.272847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c891-0c99-457f-ab1f-1ba72976a145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:24.420669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-62b6c891-0c99-457f-ab1f-1ba72976a145 None None] MFA Rules not processed for user `ca71fe047938482ab3f9c5e9f3e90418`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:24.424611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-62b6c891-0c99-457f-ab1f-1ba72976a145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:24.443320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 915/1812] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:24.444990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:24.445494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:24.445916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:24.536703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] MFA Rules not processed for user `77cdd85bff5d4911b351f34b2e13c5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:24.545902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:24.660798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 898/1813] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:24.662496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c891-0c99-457f-ab1f-1ba72976a145 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:24.690282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c891-0c99-457f-ab1f-1ba72976a145 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:24.711059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:24.714337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:24.717162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:24.717162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:24.718974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:24.719668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:24.730641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:24.770893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 916/1814] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:24.771686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 899/1815] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:24.774633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:24.780494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:24.782206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:24.812738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0055d4-7233-442d-9121-07d1edaf290b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:24.826288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf55750-b405-48cd-9eb1-35c099c2c43c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:24.826492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:24.828210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:24.832326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:24.832326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:24.835580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:24.840479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:24.841794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:24.842925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:24.844213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:24.844659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:24.846576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:24.849414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:24.905844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 900/1816] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:24 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:24.910699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:24.916336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 917/1817] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:24 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:24.921356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.010577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:25.057963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060ebc-0477-4f29-9a5c-5240aefb9b6a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.080799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.081397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.081684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.081975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.083239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.088047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.091216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0566-ffb9-4aae-a185-e8afff100514 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.108732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.109469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.109744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.110074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.110827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.113426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.138138 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 918/1818] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:24 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:25.141340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.179641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a6b75-0c12-4ed5-a8e6-e43eae53601b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.183625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 901/1819] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:24 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:25.184885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.200046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.200791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.200993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.201290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.205418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.209087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1b6d-0177-4f92-9829-b8b18ca94dfa admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.212354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.221089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.221882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.222296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.222578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.223270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.227636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.240226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 919/1820] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:25.241270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.257001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 902/1821] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:25.257001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.264438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:25.267156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac48b8-5251-4b01-91a5-c2a64270c91b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.288239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.289257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.289257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.289575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] PATH_INFO: `/v3/projects/739635168a434bdca333176d8d6b162e/users/ab719ece1fa84562aef5121b1e7bf71d/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.304892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4ea0f-dd7a-49f5-8550-7482dd3c5e5c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.333242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.333967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.335169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.335472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] PATH_INFO: `/v3/projects/652185c7344542fa89d4ca4e3d6dacc6` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.338790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652185c7344542fa89d4ca4e3d6dacc6)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.341974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.363172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:25.382957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739635168a434bdca333176d8d6b162e, user_id=ab719ece1fa84562aef5121b1e7bf71d, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.403587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.443902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 920/1822] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:25 2022] PUT /identity/v3/projects/739635168a434bdca333176d8d6b162e/users/ab719ece1fa84562aef5121b1e7bf71d/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:25.445809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.472213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652185c7344542fa89d4ca4e3d6dacc6', 'request_id': 'req-17b4c72e-d156-4a5d-a7da-f2db3fc94186'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:25.504170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652185c7344542fa89d4ca4e3d6dacc6', 'request_id': 'req-17b4c72e-d156-4a5d-a7da-f2db3fc94186'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:25.524022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652185c7344542fa89d4ca4e3d6dacc6', 'request_id': 'req-17b4c72e-d156-4a5d-a7da-f2db3fc94186'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:25.547904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] The token cache is being invalidate because project 652185c7344542fa89d4ca4e3d6dacc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:25.549183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:25.551575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:25.556125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fc4d6-848b-4fa2-9337-fb14cf796c82 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.557052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 903/1823] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:25 2022] DELETE /identity/v3/projects/652185c7344542fa89d4ca4e3d6dacc6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:25.559512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.562387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:25.660266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503fa40-f823-4380-b511-6f7853f59eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.661452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fa40-f823-4380-b511-6f7853f59eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.661887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fa40-f823-4380-b511-6f7853f59eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.663101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fa40-f823-4380-b511-6f7853f59eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.664094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503fa40-f823-4380-b511-6f7853f59eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.667121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503fa40-f823-4380-b511-6f7853f59eb2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.684605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 921/1824] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:25.686388 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.686826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.687273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.711424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:25.713106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:25.725726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 922/1825] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:25.727112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.730222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:25.731239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4c72e-d156-4a5d-a7da-f2db3fc94186 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.741017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49b6ed-2985-4882-8e75-f31f920c2e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.741650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b6ed-2985-4882-8e75-f31f920c2e69 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.741935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b6ed-2985-4882-8e75-f31f920c2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.742207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b6ed-2985-4882-8e75-f31f920c2e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.742907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49b6ed-2985-4882-8e75-f31f920c2e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.746778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49b6ed-2985-4882-8e75-f31f920c2e69 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.748623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33431572-dc13-4310-b6f2-2e5abc207d3f None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:25.768949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 904/1826] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:25.770822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412c79-066a-4c2e-a634-041e345c21ad None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.771109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412c79-066a-4c2e-a634-041e345c21ad None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.771393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412c79-066a-4c2e-a634-041e345c21ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.774373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:25.778081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:25.778631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:25.779848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] PATH_INFO: `/v3/projects/69fad75848d5421ea4f39b1dcc1f744c/users/a31d3b858fff4ec29778fd2f5b733da8/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:25.818933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fad75848d5421ea4f39b1dcc1f744c, user_id=a31d3b858fff4ec29778fd2f5b733da8, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:25.822129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:25.826511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-25412c79-066a-4c2e-a634-041e345c21ad None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:25.828685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-25412c79-066a-4c2e-a634-041e345c21ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:25.850815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 923/1827] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:25 2022] PUT /identity/v3/projects/69fad75848d5421ea4f39b1dcc1f744c/users/a31d3b858fff4ec29778fd2f5b733da8/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:25.851788 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:25.866490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:26.110272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 905/1828] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:26.113983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e78b-890f-462e-9a96-8a285549f0b0 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.114360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e78b-890f-462e-9a96-8a285549f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.116096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e78b-890f-462e-9a96-8a285549f0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.135546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e72fb-4144-4a62-bd9e-ed2431aac39a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.142810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:26.143505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.143786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.144061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] PATH_INFO: `/v3/projects/739635168a434bdca333176d8d6b162e/users/ab719ece1fa84562aef5121b1e7bf71d/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.149760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=739635168a434bdca333176d8d6b162e, user_id=ab719ece1fa84562aef5121b1e7bf71d, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:26.154625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:26.195773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 924/1829] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:25 2022] PUT /identity/v3/projects/739635168a434bdca333176d8d6b162e/users/ab719ece1fa84562aef5121b1e7bf71d/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:26.196689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:26.243645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-27f8e78b-890f-462e-9a96-8a285549f0b0 None None] MFA Rules not processed for user `a31d3b858fff4ec29778fd2f5b733da8`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:26.245568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-27f8e78b-890f-462e-9a96-8a285549f0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:26.294308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:26.357487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab050ba-4a82-40b0-82bc-b40d59f9c84e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.377357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2136-0a50-41df-8797-2d9a3b00f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:26.380302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2136-0a50-41df-8797-2d9a3b00f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.380671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2136-0a50-41df-8797-2d9a3b00f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.380947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2136-0a50-41df-8797-2d9a3b00f3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.385649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb2136-0a50-41df-8797-2d9a3b00f3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:26.385649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb2136-0a50-41df-8797-2d9a3b00f3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:26.387656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb2136-0a50-41df-8797-2d9a3b00f3ee admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:26.421066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 925/1830] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:26.421241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 906/1831] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:26.421379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.421379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.421379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.421578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e78b-890f-462e-9a96-8a285549f0b0 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:26.435127 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e78b-890f-462e-9a96-8a285549f0b0 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.441440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:26.442531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.443067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.443344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.444701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:26.447474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:26.492593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 907/1832] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:26 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:26.497359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:26.499520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] MFA Rules not processed for user `ab719ece1fa84562aef5121b1e7bf71d`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:26.501388 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:26.611008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7368a2d-e25f-4583-8620-6ffa3df70f51 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.617048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:26.617960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.617960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.618204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.618969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:26.621654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:26.630599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 926/1833] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:26.631746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:26.637590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:26.654998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c7b6a-a3bb-49dd-8ef4-3707624a1269 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.662063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:26.662647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 908/1834] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:26 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:26.663068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.663561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:26.663839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.664332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] PATH_INFO: `/v3/users/9603f07de1e54a6a9e7e18bde63e9bbd` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.666517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9603f07de1e54a6a9e7e18bde63e9bbd)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:26.668860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:26.682347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:26.744468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9603f07de1e54a6a9e7e18bde63e9bbd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:26.761950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9603f07de1e54a6a9e7e18bde63e9bbd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:26.765901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9603f07de1e54a6a9e7e18bde63e9bbd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:26.781060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41638-ca64-4f05-851e-fed2745b9ac4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.787534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9603f07de1e54a6a9e7e18bde63e9bbd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:26.796047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:26.798838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.799128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.799401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.800057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:26.802172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:26.811185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9603f07de1e54a6a9e7e18bde63e9bbd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:26.826732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 927/1835] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:26 2022] DELETE /identity/v3/users/9603f07de1e54a6a9e7e18bde63e9bbd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:26.827360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:26.829101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:26.846750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 909/1836] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:26 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:26.847499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:26.854102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:26.876095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514dae-d8fa-4eea-b558-bde11097bc6c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.899767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:26.926077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd5084-b108-4865-8d1d-3cf5af482e32 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:26.935923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:26.937030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:26.937702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:26.938084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:26.942274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:27.021512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbdd26-431d-4316-90b1-edf6fc87d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.022994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbdd26-431d-4316-90b1-edf6fc87d478 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.023272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbdd26-431d-4316-90b1-edf6fc87d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.034591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbdd26-431d-4316-90b1-edf6fc87d478 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.034952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbdd26-431d-4316-90b1-edf6fc87d478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.045470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbdd26-431d-4316-90b1-edf6fc87d478 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.114597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 910/1837] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:26 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:27.118983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571612d-a3d2-4f99-915c-f54bb11e59c9 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.119352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571612d-a3d2-4f99-915c-f54bb11e59c9 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.119545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571612d-a3d2-4f99-915c-f54bb11e59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.157226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.158839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.184282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0571612d-a3d2-4f99-915c-f54bb11e59c9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:27.187578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0571612d-a3d2-4f99-915c-f54bb11e59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:27.188577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 928/1838] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:27.189875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.193186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:27.212153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 911/1839] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:27.214208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571612d-a3d2-4f99-915c-f54bb11e59c9 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.236321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69c6f-3352-449d-9b60-50b3bfa301f1 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.238315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571612d-a3d2-4f99-915c-f54bb11e59c9 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.247736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.248404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.250272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.250562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.251226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.256151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.265260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.266067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.269174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.269602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.274109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.274269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 929/1840] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:27.274269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.275597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.276761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:27.312753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 912/1841] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:27.312753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.336336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76173a0-ec5e-4557-853d-ee072cb018e6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.344811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:27.363849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.365246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.366698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.367190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] PATH_INFO: `/v3/projects/05bf1cf7a7a94c7c99e9d7b17bc59fc5/users/4b76150c6dc04a6d96ba772dd0528805/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.401835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f3ae-a455-4f2d-a97b-d22a778c2afe admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.408950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.411428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.411880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.412269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.430983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bf1cf7a7a94c7c99e9d7b17bc59fc5, user_id=4b76150c6dc04a6d96ba772dd0528805, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.437282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.442650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.444131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.478291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 930/1842] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:27.479628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.485263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 913/1843] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:27 2022] PUT /identity/v3/projects/05bf1cf7a7a94c7c99e9d7b17bc59fc5/users/4b76150c6dc04a6d96ba772dd0528805/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:27.490613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.505739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a667168-88af-40c7-adec-0959519ee723 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.661377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.662290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.662785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.663083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.663711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.663825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3458f8c-4d8b-4b0e-8e1e-0e3657948bc2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.666862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.681070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.682020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.682565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.682972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.683673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.685333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.695166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 931/1844] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:27.696543 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.710559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace04ec-84a2-4056-9d33-de27c9d3ec6b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.717038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 914/1845] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:27.719579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:27.721687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9c1f7-5dd1-46c5-82d9-014e10419f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.722834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9c1f7-5dd1-46c5-82d9-014e10419f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.723630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9c1f7-5dd1-46c5-82d9-014e10419f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.723999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9c1f7-5dd1-46c5-82d9-014e10419f78 admin admin] PATH_INFO: `/v3/projects/755e9e75c40a445a913b770ddbdf93f9/users/26f7af4eab234bb789ab3c7b07e9508b/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.755998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d3f1b-1ca6-4363-afb1-7bc49ebdfea6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:27.763241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9c1f7-5dd1-46c5-82d9-014e10419f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755e9e75c40a445a913b770ddbdf93f9, user_id=26f7af4eab234bb789ab3c7b07e9508b, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.767115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9c1f7-5dd1-46c5-82d9-014e10419f78 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.768226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ad03-3b6d-432c-bc6c-d1366915d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:27.769003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ad03-3b6d-432c-bc6c-d1366915d391 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.769253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ad03-3b6d-432c-bc6c-d1366915d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.769672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ad03-3b6d-432c-bc6c-d1366915d391 admin admin] PATH_INFO: `/v3/projects/05bf1cf7a7a94c7c99e9d7b17bc59fc5/users/4b76150c6dc04a6d96ba772dd0528805/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.775932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2ad03-3b6d-432c-bc6c-d1366915d391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bf1cf7a7a94c7c99e9d7b17bc59fc5, user_id=4b76150c6dc04a6d96ba772dd0528805, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:27.782253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2ad03-3b6d-432c-bc6c-d1366915d391 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:27.785811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 932/1846] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:27 2022] PUT /identity/v3/projects/755e9e75c40a445a913b770ddbdf93f9/users/26f7af4eab234bb789ab3c7b07e9508b/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:27.797852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5107-bb00-4aed-bfa5-c88d2674bff1 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.798310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5107-bb00-4aed-bfa5-c88d2674bff1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.800622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5107-bb00-4aed-bfa5-c88d2674bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.808471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 915/1847] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:27 2022] PUT /identity/v3/projects/05bf1cf7a7a94c7c99e9d7b17bc59fc5/users/4b76150c6dc04a6d96ba772dd0528805/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:27.818031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:27.819014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:27.819014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:27.885649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f3da5107-bb00-4aed-bfa5-c88d2674bff1 None None] MFA Rules not processed for user `26f7af4eab234bb789ab3c7b07e9508b`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:27.886890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f3da5107-bb00-4aed-bfa5-c88d2674bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:27.888819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] MFA Rules not processed for user `4b76150c6dc04a6d96ba772dd0528805`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:27.910822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:27.970369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:28.034208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 933/1848] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:28.040096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5107-bb00-4aed-bfa5-c88d2674bff1 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.073746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 916/1849] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:28.088719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.090284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:28.152415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:28.204772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5107-bb00-4aed-bfa5-c88d2674bff1 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.208408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbeaef-7c31-45fd-96cb-13f1adfbef51 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.212070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.212825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.213168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.213469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.214354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.215670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.216498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.217423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.217713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.218359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.219703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:28.268376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 934/1850] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:28 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:28.269669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.306528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.308152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.318613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 917/1851] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:28.320178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.321633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:28.348941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490e18-41e5-4c28-a498-4199ab825e8f service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.350410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6ef6-9f0b-4cee-9226-14cde6ece0d9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.354024 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.354743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.355082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.355417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] PATH_INFO: `/v3/projects/e5d06815d92c4334a9561c1446fc79d8` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.355538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.356029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.356341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.356646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.357266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d06815d92c4334a9561c1446fc79d8)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.357386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.359171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.359303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.385862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 935/1852] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:28 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:28.389500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.401727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91dae2-5ccd-482d-9784-611aa75b31b4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.417356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d06815d92c4334a9561c1446fc79d8', 'request_id': 'req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.424849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d06815d92c4334a9561c1446fc79d8', 'request_id': 'req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.431876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d06815d92c4334a9561c1446fc79d8', 'request_id': 'req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.448275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] The token cache is being invalidate because project e5d06815d92c4334a9561c1446fc79d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:28.449403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.450699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.453356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 918/1853] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:28 2022] DELETE /identity/v3/projects/e5d06815d92c4334a9561c1446fc79d8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:28.459709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.461568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:28.471660 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.472281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.472602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.472878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.474125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.474758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:28.476342 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.487348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 936/1854] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:28.491461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.493206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:28.506964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243539-9b69-46b5-9a69-16775cea524a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.516614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.517710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.518019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.518324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.519010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.524581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.544016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 937/1855] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:28.545109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e789e9-c4b7-4ad5-90c3-13c37655e3c3 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.548652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.550763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.551283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.551793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.552139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] PATH_INFO: `/v3/users/4ccbc5a491994e5391ad171d2d272181` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.553547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccbc5a491994e5391ad171d2d272181)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.555549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.558608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af1f81-0c34-4ebb-98d7-5f84ca109bc8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:28.570126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793ac8-348e-46c8-8877-fa4aa2e9717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:28.571291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793ac8-348e-46c8-8877-fa4aa2e9717c admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.572049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793ac8-348e-46c8-8877-fa4aa2e9717c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.572541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793ac8-348e-46c8-8877-fa4aa2e9717c admin admin] PATH_INFO: `/v3/projects/9c80f4c4ea7c4d27a00e8aa41a9a2f34/users/5fb1ba3d4c2444d28b6e0c3e9f37d241/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.628025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793ac8-348e-46c8-8877-fa4aa2e9717c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c80f4c4ea7c4d27a00e8aa41a9a2f34, user_id=5fb1ba3d4c2444d28b6e0c3e9f37d241, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:28.631040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793ac8-348e-46c8-8877-fa4aa2e9717c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:28.653650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 938/1856] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:28 2022] PUT /identity/v3/projects/9c80f4c4ea7c4d27a00e8aa41a9a2f34/users/5fb1ba3d4c2444d28b6e0c3e9f37d241/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:28.663577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2d791-827f-4968-9776-ff79c82cbe3d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:28.663867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2d791-827f-4968-9776-ff79c82cbe3d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:28.664142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2d791-827f-4968-9776-ff79c82cbe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:28.714846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:28.724077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccbc5a491994e5391ad171d2d272181'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.727125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-31c2d791-827f-4968-9776-ff79c82cbe3d None None] MFA Rules not processed for user `5fb1ba3d4c2444d28b6e0c3e9f37d241`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:28.728468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-31c2d791-827f-4968-9776-ff79c82cbe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:28.754046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccbc5a491994e5391ad171d2d272181'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.779207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccbc5a491994e5391ad171d2d272181'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.781947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccbc5a491994e5391ad171d2d272181'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.782634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccbc5a491994e5391ad171d2d272181'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:28.847169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 919/1857] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:28 2022] DELETE /identity/v3/users/4ccbc5a491994e5391ad171d2d272181 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:28.925717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 939/1858] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:28.930826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:28.932607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:29.014671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8a57-9fea-43e3-9726-d0c6425a733a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.019602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:29.020769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.021217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.021626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.022447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:29.024633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:29.067889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 920/1859] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:28 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:29.069034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2d791-827f-4968-9776-ff79c82cbe3d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.186397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2d791-827f-4968-9776-ff79c82cbe3d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.288318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:29.289047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.289430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.289794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.290531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:29.292617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:29.323675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 940/1860] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:29 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:29.325081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.342336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e954c-5029-48a1-90ed-0ce39a15df54 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.350518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:29.351298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.352146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.352870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.353399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:29.355508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:29.366728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:29.376874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 921/1861] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:29.381987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.395892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726fd8c-49ba-4e9c-9225-c766855961e1 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.405038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:29.406822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.407697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.408625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] PATH_INFO: `/v3/projects/009f4fdd326244ec8c3cb4808a5cc035/users/e313b35790a7444ab2c874e57e219b90/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.450073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009f4fdd326244ec8c3cb4808a5cc035, user_id=e313b35790a7444ab2c874e57e219b90, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:29.452676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:29.472423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 941/1862] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:29 2022] PUT /identity/v3/projects/009f4fdd326244ec8c3cb4808a5cc035/users/e313b35790a7444ab2c874e57e219b90/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:29.476052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.495207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ada39-2ca5-48a7-9dc0-f8103f431a0c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.557075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.559556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:29.576372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:29.596247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:29.597391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.598747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.599470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.600115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:29.601872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:29.613326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 922/1863] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:29.617993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.627980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50859559-bd51-4079-87b8-83b7be5ecb26 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.632607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39de7b-84ee-4469-9102-858e536f7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:29.633244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39de7b-84ee-4469-9102-858e536f7416 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.633516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39de7b-84ee-4469-9102-858e536f7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.633781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39de7b-84ee-4469-9102-858e536f7416 admin admin] PATH_INFO: `/v3/projects/009f4fdd326244ec8c3cb4808a5cc035/users/e313b35790a7444ab2c874e57e219b90/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.635803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39de7b-84ee-4469-9102-858e536f7416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009f4fdd326244ec8c3cb4808a5cc035, user_id=e313b35790a7444ab2c874e57e219b90, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:29.638562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39de7b-84ee-4469-9102-858e536f7416 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:29.643677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f4f16-4ab9-4cd8-9b8e-6f79e81b9b37 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.649011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 923/1864] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:29 2022] PUT /identity/v3/projects/009f4fdd326244ec8c3cb4808a5cc035/users/e313b35790a7444ab2c874e57e219b90/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:29.660267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.661103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.661381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.694303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] MFA Rules not processed for user `e313b35790a7444ab2c874e57e219b90`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:29.695598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:29.732849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:29.733605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:29.735854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:29.736879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] PATH_INFO: `/v3/projects/42fa8996d6734ae68e273d21dd9a1a93` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:29.738318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fa8996d6734ae68e273d21dd9a1a93)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:29.741306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:29.801353 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 924/1865] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:29.804769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fa8996d6734ae68e273d21dd9a1a93', 'request_id': 'req-2a6d5c2c-c039-476f-900d-49f7faeace7f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:29.818337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.819979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:29.833100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fa8996d6734ae68e273d21dd9a1a93', 'request_id': 'req-2a6d5c2c-c039-476f-900d-49f7faeace7f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:29.849146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fa8996d6734ae68e273d21dd9a1a93', 'request_id': 'req-2a6d5c2c-c039-476f-900d-49f7faeace7f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:29.873627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] The token cache is being invalidate because project 42fa8996d6734ae68e273d21dd9a1a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:29.874014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:29.875666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:29.880605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 942/1866] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:29 2022] DELETE /identity/v3/projects/42fa8996d6734ae68e273d21dd9a1a93 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:29.891068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:29.896721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:29.938827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dde37-11b4-43c2-9eb5-9fad6dc9c443 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:29.984113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:29.990734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:30.010977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5c2c-c039-476f-900d-49f7faeace7f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:30.032948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:30.034886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:30.036674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:30.037055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] PATH_INFO: `/v3/users/c5681a5f2e394f2daadc811dea696464` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:30.040541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5681a5f2e394f2daadc811dea696464)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:30.043158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:30.059140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:30.060277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:30.061117 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:30.061879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:30.064147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:30.109549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5681a5f2e394f2daadc811dea696464'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.121205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5681a5f2e394f2daadc811dea696464'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.128145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5681a5f2e394f2daadc811dea696464'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.137336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5681a5f2e394f2daadc811dea696464'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.160141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5681a5f2e394f2daadc811dea696464'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.169027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:30.170185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 943/1867] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:29 2022] DELETE /identity/v3/users/c5681a5f2e394f2daadc811dea696464 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:30.171042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:30.185157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 925/1868] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:30.232628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:30.234464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:30.314327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1c3a-d971-47d0-8ef2-38434b21ccfe admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:30.319363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f3de6-249c-4ba8-9561-46c15fc5ba81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:30.320271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3de6-249c-4ba8-9561-46c15fc5ba81 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:30.320585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3de6-249c-4ba8-9561-46c15fc5ba81 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:30.320854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3de6-249c-4ba8-9561-46c15fc5ba81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:30.322576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2c5f3de6-249c-4ba8-9561-46c15fc5ba81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:30.386027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f3de6-249c-4ba8-9561-46c15fc5ba81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:30.387780 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f3de6-249c-4ba8-9561-46c15fc5ba81 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:30.398990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 944/1869] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:30.676799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:30.696146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2abd0d-c924-44e9-af39-668b5760e955 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:30.818693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:30.824872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:30.825164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:30.825444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] PATH_INFO: `/v3/projects/430a1991f038425b8211d1e71dc5c165` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:30.841461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=430a1991f038425b8211d1e71dc5c165)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:30.843805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:30.953484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430a1991f038425b8211d1e71dc5c165', 'request_id': 'req-e74cb55e-5425-4021-8f9d-524c98ca88cc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.963173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430a1991f038425b8211d1e71dc5c165', 'request_id': 'req-e74cb55e-5425-4021-8f9d-524c98ca88cc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.970388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430a1991f038425b8211d1e71dc5c165', 'request_id': 'req-e74cb55e-5425-4021-8f9d-524c98ca88cc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.984945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] The token cache is being invalidate because project 430a1991f038425b8211d1e71dc5c165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:30.985226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.985874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e74cb55e-5425-4021-8f9d-524c98ca88cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:30.987597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 926/1870] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:30 2022] DELETE /identity/v3/projects/430a1991f038425b8211d1e71dc5c165 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:30.994101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca18ce-f89a-44dc-86a9-352526fc1cd4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:30.994395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca18ce-f89a-44dc-86a9-352526fc1cd4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:30.994726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca18ce-f89a-44dc-86a9-352526fc1cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.019857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a4ca18ce-f89a-44dc-86a9-352526fc1cd4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:31.020805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a4ca18ce-f89a-44dc-86a9-352526fc1cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:31.049939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:31.138918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 945/1871] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:31.141885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.141885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.141885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.155486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:31.219619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:31.220990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:31.237215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 927/1872] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:31.241265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca18ce-f89a-44dc-86a9-352526fc1cd4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:31.260683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:31.262359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:31.266183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca18ce-f89a-44dc-86a9-352526fc1cd4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:31.286524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:31.287157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.287434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.287713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.292577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:31.295176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:31.302307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:31.341438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 946/1873] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:31.346887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:31.374123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60d6e-d874-4e34-b8de-f62c6ff509bb admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:31.394799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:31.395448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.395722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.396045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.396750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:31.401287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:31.441546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df006a-c532-4b70-b724-afba85a87f08 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:31.455516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:31.456125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.456441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.456845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.458751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:31.484477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 947/1874] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:31 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:31.485714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:31.590096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e2525-0eaa-4e64-a67a-ecb8c7239fea admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:31.597924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:31.598754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:31.599380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:31.599525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.599653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.599927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.601283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:31.604020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:31.610772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 928/1875] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:31.671118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 948/1876] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:31 2022] POST /identity/v3/users => generated 305 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:31.673060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:31.703184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302dff9-4d21-458c-be46-8a048c987dfc service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:31.731964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:31.733891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.734613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.735544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.737851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:31.741510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:31.778279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 929/1877] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:31.785477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:31.826200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118c05f-c30d-466e-8283-b628e69a1a51 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:31.839814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b74459-e68b-4261-83ba-7fd0e86f3816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:31.840768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b74459-e68b-4261-83ba-7fd0e86f3816 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.841046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b74459-e68b-4261-83ba-7fd0e86f3816 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.841316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b74459-e68b-4261-83ba-7fd0e86f3816 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.841964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b74459-e68b-4261-83ba-7fd0e86f3816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:31.843691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b74459-e68b-4261-83ba-7fd0e86f3816 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:31.882924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 949/1878] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:31.888335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:31.910165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101572f4-947f-49fe-a86e-e83f9db96a57 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:31.915928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:31.916833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:31.917275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:31.917708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] PATH_INFO: `/v3/projects/53a1104dc5f2448fb394eeedcf5d4612/users/851d67cccf544848b9333bd7e5b9b747/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:31.968047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a1104dc5f2448fb394eeedcf5d4612, user_id=851d67cccf544848b9333bd7e5b9b747, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:31.977040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:32.026297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 930/1879] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:31 2022] PUT /identity/v3/projects/53a1104dc5f2448fb394eeedcf5d4612/users/851d67cccf544848b9333bd7e5b9b747/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:32.036289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9993-921c-472b-9e58-05286eba3c90 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:32.036818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9993-921c-472b-9e58-05286eba3c90 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:32.037406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9993-921c-472b-9e58-05286eba3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:32.122957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2f7b9993-921c-472b-9e58-05286eba3c90 None None] MFA Rules not processed for user `851d67cccf544848b9333bd7e5b9b747`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:32.127889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2f7b9993-921c-472b-9e58-05286eba3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:32.319286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:32.339018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 950/1880] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:32 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:32.343083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:32.442388 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b9993-921c-472b-9e58-05286eba3c90 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:32.444992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a297f1-f64d-468b-a300-63487a6900d8 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:32.453492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:32.454998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:32.455483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:32.456098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:32.457054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:32.463649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:32.490097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:32.504902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 931/1881] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:32 2022] POST /identity/v3/projects => generated 407 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:32.506101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:32.548430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b9993-921c-472b-9e58-05286eba3c90 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:32.628440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29f3b-9935-47e7-a146-95a6fd41d923 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:32.638505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:32.639137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:32.639416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:32.639878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:32.641630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:32.645576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:32.647709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:32.648758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:32.649145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:32.649813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:32.651975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:32.685669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 932/1882] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:32 2022] POST /identity/v3/users => generated 310 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:32.689790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:32.721104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eeb23-a247-4b81-94f8-566637576a88 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:32.732481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:32.733213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:32.733620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:32.734216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:32.735006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:32.738220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:32.758727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:32.760897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:32.763592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 933/1883] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:32.764563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:32.777291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 951/1884] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:32.786629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5547a-a9a4-4958-a614-0b1d984511dd admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:32.799395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:32.800229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:32.800637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:32.801068 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] PATH_INFO: `/v3/projects/8c11cf61b5b04676950b4bd078d64ea1/users/370b7668b86641e69d78d0b258475be7/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:32.831489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c11cf61b5b04676950b4bd078d64ea1, user_id=370b7668b86641e69d78d0b258475be7, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:32.836547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:32.866009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 934/1885] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:32 2022] PUT /identity/v3/projects/8c11cf61b5b04676950b4bd078d64ea1/users/370b7668b86641e69d78d0b258475be7/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:32.867175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:32.905507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f22330-0c66-4535-a3c1-fa957b494c21 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:33.011472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13935a-3f48-4340-bc13-73808506b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:33.015758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13935a-3f48-4340-bc13-73808506b42d admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:33.016522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13935a-3f48-4340-bc13-73808506b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:33.016845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13935a-3f48-4340-bc13-73808506b42d admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:33.022251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13935a-3f48-4340-bc13-73808506b42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:33.026098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13935a-3f48-4340-bc13-73808506b42d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:33.040663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:33.062191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 952/1886] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:33.063791 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:33.089271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7961b-ed70-4ce4-ab9f-30da72e8e96f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:33.097742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:33.109139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:33.109848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:33.110406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] PATH_INFO: `/v3/projects/8c11cf61b5b04676950b4bd078d64ea1/users/370b7668b86641e69d78d0b258475be7/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:33.118033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c11cf61b5b04676950b4bd078d64ea1, user_id=370b7668b86641e69d78d0b258475be7, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:33.132611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:33.165305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 935/1887] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:33 2022] PUT /identity/v3/projects/8c11cf61b5b04676950b4bd078d64ea1/users/370b7668b86641e69d78d0b258475be7/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:33.179432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ca22-bb7c-4926-9652-b0222c1fc51d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:33.179734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ca22-bb7c-4926-9652-b0222c1fc51d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:33.180015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ca22-bb7c-4926-9652-b0222c1fc51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:33.221549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-35e3ca22-bb7c-4926-9652-b0222c1fc51d None None] MFA Rules not processed for user `370b7668b86641e69d78d0b258475be7`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:33.222891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-35e3ca22-bb7c-4926-9652-b0222c1fc51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:33.365507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 953/1888] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:33 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:33.380245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:33.468112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05fbcd-b9e0-4a91-ba25-ced06e301718 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:33.472627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:33.474029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:33.474377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:33.474861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:33.489144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:33.490689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:33.534853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 936/1889] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:33 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:33.787173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa054-da8a-4fb1-b8c4-49f79d5df5cb None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:33.788848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:33.790051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa054-da8a-4fb1-b8c4-49f79d5df5cb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:33.790419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aa054-da8a-4fb1-b8c4-49f79d5df5cb None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:33.790770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:33.791974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 954/1890] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:30:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:30:33.808875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ae68-d55b-478a-a252-062927d76b49 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:33.818175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:33.820332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:33.821028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:33.822379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:33.824912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:33.825384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:33.826982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:33.866520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:33.867638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:33.940488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:33.989522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:33.991973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:34.008119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 937/1891] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:33 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:34.053950 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 955/1892] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:30:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:34.096727 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:34.098759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:34.146672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:34.148354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:34.165041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35e3b7-0319-4e55-a9c1-39bb7d23f3a2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:34.174795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a498a9-e575-4445-8120-f7a5655219be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:34.175760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a498a9-e575-4445-8120-f7a5655219be service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:34.176456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a498a9-e575-4445-8120-f7a5655219be service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:34.176896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a498a9-e575-4445-8120-f7a5655219be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:34.187377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a498a9-e575-4445-8120-f7a5655219be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:34.189059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a498a9-e575-4445-8120-f7a5655219be service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:34.204032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 956/1893] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:34.242665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166cef-7d55-4a86-a0b5-33d22ec23075 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:34.249062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:34.249901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:34.250336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:34.250660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] PATH_INFO: `/v3/users/26f7af4eab234bb789ab3c7b07e9508b` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:34.252074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f7af4eab234bb789ab3c7b07e9508b)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:34.255455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:34.339018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f7af4eab234bb789ab3c7b07e9508b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:34.347091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f7af4eab234bb789ab3c7b07e9508b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:34.359850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f7af4eab234bb789ab3c7b07e9508b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:34.360807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f7af4eab234bb789ab3c7b07e9508b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:34.361630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f7af4eab234bb789ab3c7b07e9508b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:34.428655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 938/1894] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:34 2022] DELETE /identity/v3/users/26f7af4eab234bb789ab3c7b07e9508b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:34.433028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:34.433319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:34.433594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:34.467355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:34.470257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:34.596744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 957/1895] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:34.638567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:34.639909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:34.733314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a72a-c427-4899-b13d-6b7d4dd35f7c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:34.737862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:34.738622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:34.739052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:34.739381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:34.754176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:34.756026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:34.785331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 939/1896] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:35.425073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:35.426553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:35.437103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:35.441370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa6e7-e3f8-4af7-95e2-bff488ceeaa8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:35.446486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:35.447332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:35.447607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:35.447877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] PATH_INFO: `/v3/projects/755e9e75c40a445a913b770ddbdf93f9` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:35.449114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755e9e75c40a445a913b770ddbdf93f9)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:35.451025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:35.497323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755e9e75c40a445a913b770ddbdf93f9', 'request_id': 'req-ff39453a-9192-4f1e-a619-321a656473b5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.503273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755e9e75c40a445a913b770ddbdf93f9', 'request_id': 'req-ff39453a-9192-4f1e-a619-321a656473b5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.511914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755e9e75c40a445a913b770ddbdf93f9', 'request_id': 'req-ff39453a-9192-4f1e-a619-321a656473b5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.523227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] The token cache is being invalidate because project 755e9e75c40a445a913b770ddbdf93f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:35.523517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.524154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.525665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 958/1897] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:35 2022] DELETE /identity/v3/projects/755e9e75c40a445a913b770ddbdf93f9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:35.529671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:35.534476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:35.540927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba6da-c3ad-41a2-b386-929ec7dad5a0 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:35.597616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:35.598333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:35.598616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:35.598897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] PATH_INFO: `/v3/users/5fb1ba3d4c2444d28b6e0c3e9f37d241` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:35.600014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb1ba3d4c2444d28b6e0c3e9f37d241)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:35.601969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:35.646082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb1ba3d4c2444d28b6e0c3e9f37d241'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.652852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb1ba3d4c2444d28b6e0c3e9f37d241'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.659998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb1ba3d4c2444d28b6e0c3e9f37d241'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.661234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb1ba3d4c2444d28b6e0c3e9f37d241'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.661847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb1ba3d4c2444d28b6e0c3e9f37d241'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:35.678885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 940/1898] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:35 2022] DELETE /identity/v3/users/5fb1ba3d4c2444d28b6e0c3e9f37d241 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:36.092241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:36.093804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:36.108015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39453a-9192-4f1e-a619-321a656473b5 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:36.196545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:36.199033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:36.199327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:36.199840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] PATH_INFO: `/v3/projects/9c80f4c4ea7c4d27a00e8aa41a9a2f34` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:36.201196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c80f4c4ea7c4d27a00e8aa41a9a2f34)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:36.203452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:36.293142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c80f4c4ea7c4d27a00e8aa41a9a2f34', 'request_id': 'req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.306637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c80f4c4ea7c4d27a00e8aa41a9a2f34', 'request_id': 'req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.318953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c80f4c4ea7c4d27a00e8aa41a9a2f34', 'request_id': 'req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.336773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] The token cache is being invalidate because project 9c80f4c4ea7c4d27a00e8aa41a9a2f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:36.337116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.337840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.343349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 959/1899] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:36 2022] DELETE /identity/v3/projects/9c80f4c4ea7c4d27a00e8aa41a9a2f34 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:36.344507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:36.345998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:36.373913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e6fd2-f346-4589-988a-fde56f897950 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:36.484503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:36.485261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:36.486753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:36.487127 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] PATH_INFO: `/v3/users/e313b35790a7444ab2c874e57e219b90` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:36.489597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e313b35790a7444ab2c874e57e219b90)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:36.492827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:36.520417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:36.551738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e313b35790a7444ab2c874e57e219b90'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.559865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e313b35790a7444ab2c874e57e219b90'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.567239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e313b35790a7444ab2c874e57e219b90'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.568137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e313b35790a7444ab2c874e57e219b90'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.568799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1481d91a-41dd-49ed-aaff-b9cbdc19d6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e313b35790a7444ab2c874e57e219b90'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:36.587462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 941/1900] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:36 2022] DELETE /identity/v3/users/e313b35790a7444ab2c874e57e219b90 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:37.032111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:37.033805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:37.053969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be4f1-c3dd-4428-bf16-ded49ccf918d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:37.112634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:37.191084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:37.192359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.192875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.193224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] PATH_INFO: `/v3/projects/009f4fdd326244ec8c3cb4808a5cc035` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.194565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009f4fdd326244ec8c3cb4808a5cc035)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:37.196697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:37.311607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009f4fdd326244ec8c3cb4808a5cc035', 'request_id': 'req-13fcb465-c290-42a9-a7c6-7c774be789a8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:37.321482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009f4fdd326244ec8c3cb4808a5cc035', 'request_id': 'req-13fcb465-c290-42a9-a7c6-7c774be789a8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:37.334502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009f4fdd326244ec8c3cb4808a5cc035', 'request_id': 'req-13fcb465-c290-42a9-a7c6-7c774be789a8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:37.356532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] The token cache is being invalidate because project 009f4fdd326244ec8c3cb4808a5cc035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:37.356905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:37.357482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-13fcb465-c290-42a9-a7c6-7c774be789a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:37.363824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 960/1901] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:37 2022] DELETE /identity/v3/projects/009f4fdd326244ec8c3cb4808a5cc035 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:37.365360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37033263-c14a-4bff-bd51-d741eadff165 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.365735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37033263-c14a-4bff-bd51-d741eadff165 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.365967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37033263-c14a-4bff-bd51-d741eadff165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.414690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-37033263-c14a-4bff-bd51-d741eadff165 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:37.416303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-37033263-c14a-4bff-bd51-d741eadff165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:37.508679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 942/1902] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:37.514613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8f4e-3f0d-4453-960b-d3302f9392d4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.514613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8f4e-3f0d-4453-960b-d3302f9392d4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.514613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8f4e-3f0d-4453-960b-d3302f9392d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.548591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-aaba8f4e-3f0d-4453-960b-d3302f9392d4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:37.549817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-aaba8f4e-3f0d-4453-960b-d3302f9392d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:37.574472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 961/1903] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:37.579172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37033263-c14a-4bff-bd51-d741eadff165 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:37.593385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37033263-c14a-4bff-bd51-d741eadff165 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:37.609578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:37.610212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.610516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.610783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.611440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:37.611742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:37.613936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:37.638111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 943/1904] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:37.642433 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8f4e-3f0d-4453-960b-d3302f9392d4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:37.659423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8f4e-3f0d-4453-960b-d3302f9392d4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:37.668224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:37.668935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.669221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.669494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.670332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:37.672282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:37.715911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 962/1905] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:37 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:37.721621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:37.742096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d695e-3cff-4656-b766-297668f86bce admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:37.825198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:37.825855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.826292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.826592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.827376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:37.829785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:37.866586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 944/1906] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:37 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:37.867240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:37.880217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46bd1a-861d-4b19-a9d2-41b3b40688d0 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:37.887785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:37.888843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.889148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.889519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.890239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:37.892097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:37.914658 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 963/1907] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:37.919108 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:37.929679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423396-57f4-4612-b36f-e5ac4bed04fe admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:37.934346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a85fc-0ab4-45bf-8dcf-564a6338a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:37.934978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a85fc-0ab4-45bf-8dcf-564a6338a03a admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.935311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a85fc-0ab4-45bf-8dcf-564a6338a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.935567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a85fc-0ab4-45bf-8dcf-564a6338a03a admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.936201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a85fc-0ab4-45bf-8dcf-564a6338a03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:37.937886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a85fc-0ab4-45bf-8dcf-564a6338a03a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:37.948338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 945/1908] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:37.952439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:37.962272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7051b-5ede-4890-8cb8-7b6b29a2407e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:37.966775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:37.967483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:37.967804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:37.968080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] PATH_INFO: `/v3/projects/8ee67f9230964b80b4c91b52366bfe28/users/a2e5aedc85c5407e918c88a793ac2930/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:37.983829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee67f9230964b80b4c91b52366bfe28, user_id=a2e5aedc85c5407e918c88a793ac2930, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:37.986879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.004029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 964/1909] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:37 2022] PUT /identity/v3/projects/8ee67f9230964b80b4c91b52366bfe28/users/a2e5aedc85c5407e918c88a793ac2930/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:38.015304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663066cb-f284-442d-b428-7941ca792cbf None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.015779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663066cb-f284-442d-b428-7941ca792cbf None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.016086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663066cb-f284-442d-b428-7941ca792cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.031106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:38.049874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-663066cb-f284-442d-b428-7941ca792cbf None None] MFA Rules not processed for user `a2e5aedc85c5407e918c88a793ac2930`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:38.052045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-663066cb-f284-442d-b428-7941ca792cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:38.120987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 946/1910] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:38.125489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.174070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:38.192063 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d02d8-bacd-4a0d-acd5-43db0038c0cd admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.196757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.197362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.197643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.197917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.198544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.200467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.227617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 965/1911] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:38 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:38.232020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663066cb-f284-442d-b428-7941ca792cbf None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.243010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663066cb-f284-442d-b428-7941ca792cbf None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.303270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.303998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.304302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.304614 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.305252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.307382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.311371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.313169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:38.327069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952ad0e-f3ea-401e-ab82-12cfea68d943 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.330874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 947/1912] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:38 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:38.334325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.334845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.335138 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.335338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.335470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] PATH_INFO: `/v3/users/ca71fe047938482ab3f9c5e9f3e90418` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.336692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca71fe047938482ab3f9c5e9f3e90418)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.339266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.345183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfbf7f-1c17-4989-bd0c-29ac2e6c00c5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.351359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.351958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.352235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.352541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.353182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.355270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.365480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 948/1913] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:38.369971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.380008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfcf41-681e-4f10-b8ab-3fb1747e82c5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.384718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.385440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.385787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.386182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] PATH_INFO: `/v3/projects/426b0e03191744f7919bf1b3ee00c4ec/users/984a0fddd26548ac993ff96a5ed22318/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.394203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca71fe047938482ab3f9c5e9f3e90418'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:38.402266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] RBAC: Authorizing `identity:create_grant(project_id=426b0e03191744f7919bf1b3ee00c4ec, user_id=984a0fddd26548ac993ff96a5ed22318, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.402531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca71fe047938482ab3f9c5e9f3e90418'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:38.403218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca71fe047938482ab3f9c5e9f3e90418'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:38.404990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.412934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca71fe047938482ab3f9c5e9f3e90418'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:38.419453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 949/1914] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:38 2022] PUT /identity/v3/projects/426b0e03191744f7919bf1b3ee00c4ec/users/984a0fddd26548ac993ff96a5ed22318/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:38.423280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.431145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a0dc0362-7c2a-46a5-8476-b17ef9f227e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca71fe047938482ab3f9c5e9f3e90418'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:38.438525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 966/1915] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:38 2022] DELETE /identity/v3/users/ca71fe047938482ab3f9c5e9f3e90418 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:38.443028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.443383 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.443769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.464801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:38.466189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:38.482448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:38.508329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ec5fd-0723-4ce2-9651-a3054d86178e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.596708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 967/1916] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:38.612121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.617252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:38.651870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.652680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.652964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.653412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.654237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.656585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.684625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 950/1917] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:38.686182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:38.692550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:38.714427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:38.719261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97c52-7b02-468b-828e-c787b8b88e7f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.734983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a40e0-28c6-490f-99c8-3d460f612aef None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:38.737208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc785b-8ff9-4f2d-98b0-2a8ad95bcf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.738028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc785b-8ff9-4f2d-98b0-2a8ad95bcf0a admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.738869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc785b-8ff9-4f2d-98b0-2a8ad95bcf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.739154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc785b-8ff9-4f2d-98b0-2a8ad95bcf0a admin admin] PATH_INFO: `/v3/projects/426b0e03191744f7919bf1b3ee00c4ec/users/984a0fddd26548ac993ff96a5ed22318/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.741925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc785b-8ff9-4f2d-98b0-2a8ad95bcf0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=426b0e03191744f7919bf1b3ee00c4ec, user_id=984a0fddd26548ac993ff96a5ed22318, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.745670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc785b-8ff9-4f2d-98b0-2a8ad95bcf0a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.749811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:38.750447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.750727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.750998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.777459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:38.778931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:38.786955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 951/1918] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:38 2022] PUT /identity/v3/projects/426b0e03191744f7919bf1b3ee00c4ec/users/984a0fddd26548ac993ff96a5ed22318/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:38.797837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:38.798122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:38.798394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:38.803047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 968/1919] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:38.845008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] MFA Rules not processed for user `984a0fddd26548ac993ff96a5ed22318`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:38.846913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:39.023069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 952/1920] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:39.031338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:39.032814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:39.235831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee106422-f4d5-42a2-9cfe-a78f1ad2dc4b service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:39.342586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:39.343420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:39.343851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:39.344918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:39.360768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:39.362281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:39.377611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 969/1921] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:39.414418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:39.416602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:39.554226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:39.565649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eabccd-5e8d-4dce-8799-f63d01299913 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:39.568356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347da7-8afd-4dee-aaee-21dfeb5d18b4 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:39.570910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:39.571542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:39.571816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:39.572107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] PATH_INFO: `/v3/projects/91e432a4e3c34f5f8d9a864aa5cfbbd9` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:39.573336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e432a4e3c34f5f8d9a864aa5cfbbd9)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:39.575548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:39.578325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:39.579212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:39.579602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:39.579986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:39.582519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:39.586401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:39.665381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e432a4e3c34f5f8d9a864aa5cfbbd9', 'request_id': 'req-21666ac1-be52-4ef2-8fcf-747daca9b44a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.685030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:39.686491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:39.687424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e432a4e3c34f5f8d9a864aa5cfbbd9', 'request_id': 'req-21666ac1-be52-4ef2-8fcf-747daca9b44a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.696156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e432a4e3c34f5f8d9a864aa5cfbbd9', 'request_id': 'req-21666ac1-be52-4ef2-8fcf-747daca9b44a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.696705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 970/1922] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:39.713868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] The token cache is being invalidate because project 91e432a4e3c34f5f8d9a864aa5cfbbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:39.714330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.715811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.718169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 953/1923] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:39 2022] DELETE /identity/v3/projects/91e432a4e3c34f5f8d9a864aa5cfbbd9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:39.722176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:39.736816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4d525-72c5-4c7b-9029-f86f2bae69f4 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:39.796530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:39.836140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:39.837294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:39.837806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:39.838275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] PATH_INFO: `/v3/users/ab719ece1fa84562aef5121b1e7bf71d` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:39.840086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab719ece1fa84562aef5121b1e7bf71d)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:39.842348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:39.898551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab719ece1fa84562aef5121b1e7bf71d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.910034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab719ece1fa84562aef5121b1e7bf71d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.911333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab719ece1fa84562aef5121b1e7bf71d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.923800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab719ece1fa84562aef5121b1e7bf71d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.945273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab719ece1fa84562aef5121b1e7bf71d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:39.952465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 971/1924] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:39 2022] DELETE /identity/v3/users/ab719ece1fa84562aef5121b1e7bf71d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:40.272272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:40.273586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:40.289013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666ac1-be52-4ef2-8fcf-747daca9b44a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:40.354463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:40.355927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:40.373031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:40.374644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.374924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.375198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] PATH_INFO: `/v3/users/851d67cccf544848b9333bd7e5b9b747` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.376765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851d67cccf544848b9333bd7e5b9b747)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:40.378883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:40.436263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be65c33-37a8-4f34-acec-33ab4c678a52 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:40.448209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:40.449085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.449368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.449644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] PATH_INFO: `/v3/projects/739635168a434bdca333176d8d6b162e` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.451213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] RBAC: Authorizing `identity:delete_project(project_id=739635168a434bdca333176d8d6b162e)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:40.454724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:40.464805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851d67cccf544848b9333bd7e5b9b747'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.474344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851d67cccf544848b9333bd7e5b9b747'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.484789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851d67cccf544848b9333bd7e5b9b747'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.485461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851d67cccf544848b9333bd7e5b9b747'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.486081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b407fe65-d4aa-4fda-9944-b63c7d528281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851d67cccf544848b9333bd7e5b9b747'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.510839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 954/1925] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:40 2022] DELETE /identity/v3/users/851d67cccf544848b9333bd7e5b9b747 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:40.512860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.513164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.513442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.526031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739635168a434bdca333176d8d6b162e', 'request_id': 'req-4f3d47bb-a266-4abc-9452-211af9b0777d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.535174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739635168a434bdca333176d8d6b162e', 'request_id': 'req-4f3d47bb-a266-4abc-9452-211af9b0777d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.547447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739635168a434bdca333176d8d6b162e', 'request_id': 'req-4f3d47bb-a266-4abc-9452-211af9b0777d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.550410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:40.557767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:40.559070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:40.570259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] The token cache is being invalidate because project 739635168a434bdca333176d8d6b162e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:40.570535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:40.570941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.572406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4f3d47bb-a266-4abc-9452-211af9b0777d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:40.574386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 972/1926] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:40 2022] DELETE /identity/v3/projects/739635168a434bdca333176d8d6b162e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:40.584661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d3c2-907e-4c23-98a3-7fa2f61456f2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.585234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d3c2-907e-4c23-98a3-7fa2f61456f2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.586204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d3c2-907e-4c23-98a3-7fa2f61456f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.616359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f645d3c2-907e-4c23-98a3-7fa2f61456f2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:40.618238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f645d3c2-907e-4c23-98a3-7fa2f61456f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:40.662104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 955/1927] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:40.673633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:40.677771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:40.750143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 973/1928] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:40.759608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fe12e-ebb1-4259-a72c-66f30babef35 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.759833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fe12e-ebb1-4259-a72c-66f30babef35 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.760107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fe12e-ebb1-4259-a72c-66f30babef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.788452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ac56a-c841-40f5-b47d-43086bc0137c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:40.808303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:40.808997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.809365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.809637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.827823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:40.831557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:40.832242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-333fe12e-ebb1-4259-a72c-66f30babef35 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:40.833791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-333fe12e-ebb1-4259-a72c-66f30babef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:40.846721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 974/1929] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:40.847145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 956/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:40.849264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fe12e-ebb1-4259-a72c-66f30babef35 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:40.861036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fe12e-ebb1-4259-a72c-66f30babef35 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:40.868306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:40.869754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.870279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.870707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.871592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:40.872149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:40.874195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:40.895402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:40.895747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 975/1931] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:40.912499 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f2917-a57e-44bc-80b3-98d5e2b73a93 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:40.918347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:40.919235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:40.919582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:40.920232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:40.922027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:40.924717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:40.978265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 957/1932] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:40 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:40.979986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:40.992567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998285eb-ac78-480e-bb55-b881421bbcd1 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.093974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.094615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.094894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.095203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.095961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.103241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.136515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 976/1933] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:40 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:41.136799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:41.149978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e87ea-3edb-47ff-80bd-3a8c0717d242 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.156032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.156931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.157347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.157677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.158711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.161519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.184702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 958/1934] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:41.188697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:41.214618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5058c-2344-4d99-9364-9735bb06295e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.240029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.241479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:41.242360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.242712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.242985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.243631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.245323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.251616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:41.273913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa51b2-5b73-4763-bacd-67ac2c2b07aa admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.308563 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.309265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.309545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.309818 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] PATH_INFO: `/v3/projects/53a1104dc5f2448fb394eeedcf5d4612` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.315121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 977/1935] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:41.315848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:41.318785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a1104dc5f2448fb394eeedcf5d4612)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.320918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.343432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08f44-9ded-4d85-9867-7f7ec7134c54 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.353709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c58e1-eba3-4ae5-a4d2-bd35295e7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.354444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c58e1-eba3-4ae5-a4d2-bd35295e7dda admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.354723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c58e1-eba3-4ae5-a4d2-bd35295e7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.356609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c58e1-eba3-4ae5-a4d2-bd35295e7dda admin admin] PATH_INFO: `/v3/projects/493a2444b03f4e2b9c3a2114c6660203/users/cf732b1523ac4054a54972073d764a7c/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.392341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c58e1-eba3-4ae5-a4d2-bd35295e7dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=493a2444b03f4e2b9c3a2114c6660203, user_id=cf732b1523ac4054a54972073d764a7c, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.396193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c58e1-eba3-4ae5-a4d2-bd35295e7dda admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.424200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 978/1936] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:41 2022] PUT /identity/v3/projects/493a2444b03f4e2b9c3a2114c6660203/users/cf732b1523ac4054a54972073d764a7c/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:41.438044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.439947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.440324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.487324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a1104dc5f2448fb394eeedcf5d4612', 'request_id': 'req-49d2bde6-402d-49d3-a6f5-1f2f296d3162'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.496126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] MFA Rules not processed for user `cf732b1523ac4054a54972073d764a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:41.497376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a1104dc5f2448fb394eeedcf5d4612', 'request_id': 'req-49d2bde6-402d-49d3-a6f5-1f2f296d3162'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.500113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:41.505180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a1104dc5f2448fb394eeedcf5d4612', 'request_id': 'req-49d2bde6-402d-49d3-a6f5-1f2f296d3162'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.514409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:41.555338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] The token cache is being invalidate because project 53a1104dc5f2448fb394eeedcf5d4612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:41.555647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.556811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.569431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 959/1937] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:41 2022] DELETE /identity/v3/projects/53a1104dc5f2448fb394eeedcf5d4612 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:41.570824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:41.572751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:41.588179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:41.601512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 979/1938] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:41.615396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:41.616629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:41.701798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2bde6-402d-49d3-a6f5-1f2f296d3162 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.708536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.709181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.709458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.709737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] PATH_INFO: `/v3/users/370b7668b86641e69d78d0b258475be7` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.711268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] RBAC: Authorizing `identity:delete_user(user_id=370b7668b86641e69d78d0b258475be7)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.713590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.718741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e91b5f-6769-4bf7-81e0-a83f4ce57dbd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.724613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.725302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.725584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.725860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.736552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.738353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.751166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 980/1939] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:41.783379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370b7668b86641e69d78d0b258475be7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.784181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:41.789086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:41.794215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370b7668b86641e69d78d0b258475be7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.807494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370b7668b86641e69d78d0b258475be7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.808269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370b7668b86641e69d78d0b258475be7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.809687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-935b0197-bb9b-4f31-ae87-be9ba3e8125c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370b7668b86641e69d78d0b258475be7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:41.812136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c93d9-91ea-43cc-a4d7-6c6d22516f98 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:41.818551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:41.819448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:41.820402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:41.820791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] PATH_INFO: `/v3/users/cf732b1523ac4054a54972073d764a7c` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:41.822560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf732b1523ac4054a54972073d764a7c)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:41.825368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:41.831416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 960/1940] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:41 2022] DELETE /identity/v3/users/370b7668b86641e69d78d0b258475be7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:41.951632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf732b1523ac4054a54972073d764a7c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.000915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf732b1523ac4054a54972073d764a7c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.003046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf732b1523ac4054a54972073d764a7c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.026982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf732b1523ac4054a54972073d764a7c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.059035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf732b1523ac4054a54972073d764a7c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.067078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 981/1941] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:41 2022] DELETE /identity/v3/users/cf732b1523ac4054a54972073d764a7c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:42.076871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:42.077174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:42.077438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:42.110042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:42.111640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:42.224433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 961/1942] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:42.245017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:42.246869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:42.317596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:42.356161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a40acd-209d-4399-acbb-66c0d5b45685 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:42.359957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a5c4e-4463-4cc8-89dc-8b6ca73d04df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:42.360624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a5c4e-4463-4cc8-89dc-8b6ca73d04df service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:42.360909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a5c4e-4463-4cc8-89dc-8b6ca73d04df service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:42.361187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a5c4e-4463-4cc8-89dc-8b6ca73d04df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:42.371258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a5c4e-4463-4cc8-89dc-8b6ca73d04df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:42.373004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a5c4e-4463-4cc8-89dc-8b6ca73d04df service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:42.384689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 982/1943] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:42.395376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:42.397039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:42.410661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d5cec-d642-49a5-87ae-c3aa59017cd6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:42.415468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:42.416115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:42.416418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:42.416697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] PATH_INFO: `/v3/projects/8c11cf61b5b04676950b4bd078d64ea1` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:42.417861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c11cf61b5b04676950b4bd078d64ea1)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:42.419860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:42.470097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:42.508535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c11cf61b5b04676950b4bd078d64ea1', 'request_id': 'req-09627481-b4db-4efa-b13f-922617e5962a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.515857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c11cf61b5b04676950b4bd078d64ea1', 'request_id': 'req-09627481-b4db-4efa-b13f-922617e5962a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.526126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c11cf61b5b04676950b4bd078d64ea1', 'request_id': 'req-09627481-b4db-4efa-b13f-922617e5962a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.554695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] The token cache is being invalidate because project 8c11cf61b5b04676950b4bd078d64ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:42.555179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.556786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09627481-b4db-4efa-b13f-922617e5962a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:42.565577 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 962/1944] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:42 2022] DELETE /identity/v3/projects/8c11cf61b5b04676950b4bd078d64ea1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:42.567552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c1425-fc34-4d6e-aae6-a79968f3e000 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:42.568144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c1425-fc34-4d6e-aae6-a79968f3e000 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:42.568556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c1425-fc34-4d6e-aae6-a79968f3e000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:42.598774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-688c1425-fc34-4d6e-aae6-a79968f3e000 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:42.601289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-688c1425-fc34-4d6e-aae6-a79968f3e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:42.782937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 983/1945] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:42.783493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764e26-e9d6-42fb-9988-bb20141b8593 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:42.784005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764e26-e9d6-42fb-9988-bb20141b8593 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:42.784325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764e26-e9d6-42fb-9988-bb20141b8593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:42.842640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-eb764e26-e9d6-42fb-9988-bb20141b8593 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:42.843871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-eb764e26-e9d6-42fb-9988-bb20141b8593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:42.875822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 963/1946] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:42.880416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c1425-fc34-4d6e-aae6-a79968f3e000 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:42.897909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c1425-fc34-4d6e-aae6-a79968f3e000 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:42.910961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:42.911795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:42.912167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:42.912676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:42.916303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:42.917030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:42.920594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:42.943025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 984/1947] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:42.948030 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764e26-e9d6-42fb-9988-bb20141b8593 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:42.961540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764e26-e9d6-42fb-9988-bb20141b8593 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:42.969385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:42.970596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:42.971078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:42.971711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:42.973183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:42.976526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.011906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 964/1948] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:42 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:43.023406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.034336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b4712-74ce-46c2-ad86-4adde1e1a02f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.114554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.115383 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.115925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.116337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.117281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.119452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.173764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.176047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:43.185881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 985/1949] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:43 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:43.187742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.202339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39435cc0-25aa-4c9e-a48b-5f145c01737b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.219123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.219761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.220041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.220315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] PATH_INFO: `/v3/projects/493a2444b03f4e2b9c3a2114c6660203` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.223976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=493a2444b03f4e2b9c3a2114c6660203)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.227773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.240787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16682c-a6c3-41c2-b068-86ee7198780c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.253108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.255068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.255340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.255614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.257787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.263221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.297834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 986/1950] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:43.298881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.312914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a2d0c-ef4f-4201-beb3-d6177ac4ec26 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.334865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493a2444b03f4e2b9c3a2114c6660203', 'request_id': 'req-9830eff4-8e46-4b31-a96f-2aa4e1897aca'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:43.351701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493a2444b03f4e2b9c3a2114c6660203', 'request_id': 'req-9830eff4-8e46-4b31-a96f-2aa4e1897aca'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:43.364870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493a2444b03f4e2b9c3a2114c6660203', 'request_id': 'req-9830eff4-8e46-4b31-a96f-2aa4e1897aca'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:43.371703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:43.389701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] The token cache is being invalidate because project 493a2444b03f4e2b9c3a2114c6660203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:43.391095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:43.392517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9830eff4-8e46-4b31-a96f-2aa4e1897aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:43.395845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 965/1951] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:43 2022] DELETE /identity/v3/projects/493a2444b03f4e2b9c3a2114c6660203 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:43.401110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495880-7cc0-4f78-9831-cf19e9204f84 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.401507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495880-7cc0-4f78-9831-cf19e9204f84 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.402680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495880-7cc0-4f78-9831-cf19e9204f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.423544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.423544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.424771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.425046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.426966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.433264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.438256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-66495880-7cc0-4f78-9831-cf19e9204f84 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:43.440410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-66495880-7cc0-4f78-9831-cf19e9204f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:43.459729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 987/1952] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:43.461750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 966/1953] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:43.463727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.466374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:43.469202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac5d4-799a-4f1b-bfbe-fc13c80cc104 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.469500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac5d4-799a-4f1b-bfbe-fc13c80cc104 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.469776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac5d4-799a-4f1b-bfbe-fc13c80cc104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.480049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d72ec-e20c-4d0b-9be1-b13223d1f0fb admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.492211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f12a84-d393-4a71-a418-06842df5b2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.495358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12a84-d393-4a71-a418-06842df5b2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.495857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12a84-d393-4a71-a418-06842df5b2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.496427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f12a84-d393-4a71-a418-06842df5b2bd admin admin] PATH_INFO: `/v3/projects/d6c5840b41be4b50a2cb9693aef303d0/users/e94ad715e0ae483897e8303351577b02/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.509404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a03ac5d4-799a-4f1b-bfbe-fc13c80cc104 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:43.510790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a03ac5d4-799a-4f1b-bfbe-fc13c80cc104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:43.522466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f12a84-d393-4a71-a418-06842df5b2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c5840b41be4b50a2cb9693aef303d0, user_id=e94ad715e0ae483897e8303351577b02, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.525481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f12a84-d393-4a71-a418-06842df5b2bd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.540885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 967/1954] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:43.546851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ac5d4-799a-4f1b-bfbe-fc13c80cc104 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.562960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 988/1955] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:43 2022] PUT /identity/v3/projects/d6c5840b41be4b50a2cb9693aef303d0/users/e94ad715e0ae483897e8303351577b02/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:43.567628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ac5d4-799a-4f1b-bfbe-fc13c80cc104 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.576840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234b427-4057-4ebf-b6e4-c84cec633df2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.577120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234b427-4057-4ebf-b6e4-c84cec633df2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.577414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234b427-4057-4ebf-b6e4-c84cec633df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.619568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3234b427-4057-4ebf-b6e4-c84cec633df2 None None] MFA Rules not processed for user `e94ad715e0ae483897e8303351577b02`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:43.624507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3234b427-4057-4ebf-b6e4-c84cec633df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:43.696351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:43.720429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.720429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.720695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.720969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.721626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:43.721933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.723584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.747180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 989/1956] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:43.750948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 968/1957] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:43.755334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234b427-4057-4ebf-b6e4-c84cec633df2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.774257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.777874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:43.793126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234b427-4057-4ebf-b6e4-c84cec633df2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.807464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.808003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.808281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.808604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.809238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.811153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.856658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d9f2-68e3-4e2d-a4ac-23ded59b8116 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:43.863301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 990/1958] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:43 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:43.863954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:43.864600 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:43.864886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:43.865154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:43.868793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.875491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:43.877360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:43.892116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 969/1959] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:43.917447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:43.941691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928453f-a542-4789-961b-a84ce12ac24c service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:44.026116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5bb2e-86bf-4598-b06a-0558c64697db admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:44.032540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:44.033340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.033621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.033927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.034657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:44.037422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:44.080659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 991/1960] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:43 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:44.081116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:44.081799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.082076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.082354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] PATH_INFO: `/v3/users/e94ad715e0ae483897e8303351577b02` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.085018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:44.088041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94ad715e0ae483897e8303351577b02)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:44.094576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:44.106148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd3680-9284-4893-a2bf-d6bc049af61d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:44.115115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:44.116199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.117023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.117023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.118998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:44.121614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:44.125538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:44.150871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 992/1961] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:44.153198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:44.169484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28b3c8-4a86-47ff-a3fd-e0b5d8b3909a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:44.190277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:44.191044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.191663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.192188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.193485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:44.199933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:44.202939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94ad715e0ae483897e8303351577b02'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:44.218856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94ad715e0ae483897e8303351577b02'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:44.228909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 993/1962] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:44.234275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:44.241544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94ad715e0ae483897e8303351577b02'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:44.242576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94ad715e0ae483897e8303351577b02'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:44.243238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d079c25f-50aa-4aa0-871f-9dc66d8d1c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94ad715e0ae483897e8303351577b02'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:44.262610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4cb7e-8880-49cb-9879-a84efbfa5370 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:44.273661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283418b-df10-4359-8d46-ef619408d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:44.274802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283418b-df10-4359-8d46-ef619408d2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.275144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283418b-df10-4359-8d46-ef619408d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.275450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283418b-df10-4359-8d46-ef619408d2c0 admin admin] PATH_INFO: `/v3/projects/6f52c456f58d4f05aada138caaa1b1be/users/ac35338a589644379a7ace40d7d450d9/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.288243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 970/1963] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:43 2022] DELETE /identity/v3/users/e94ad715e0ae483897e8303351577b02 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:44.302316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.302989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.303881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.312898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283418b-df10-4359-8d46-ef619408d2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f52c456f58d4f05aada138caaa1b1be, user_id=ac35338a589644379a7ace40d7d450d9, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:44.316772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283418b-df10-4359-8d46-ef619408d2c0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:44.340467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 994/1964] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:44 2022] PUT /identity/v3/projects/6f52c456f58d4f05aada138caaa1b1be/users/ac35338a589644379a7ace40d7d450d9/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:44.351218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:44.354316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:44.359460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.359769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.360062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.362725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:44.419132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] MFA Rules not processed for user `ac35338a589644379a7ace40d7d450d9`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:44.422538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:44.498576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 971/1965] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:44.516623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:44.520153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:44.591618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 995/1966] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:44.603184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:44.605007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:44.615601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a2fb5-9c30-4e1c-a933-a9f254f791cc None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:44.621867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:44.623564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.624045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.624718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.641177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:44.643125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:44.671124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 972/1967] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:44.729182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc85b0-84ba-4d2c-ae81-9ff7af3cfb98 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:44.733264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9c99-9296-45ff-9478-3e278ba26d65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:44.734146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9c99-9296-45ff-9478-3e278ba26d65 service glance] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:44.734497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9c99-9296-45ff-9478-3e278ba26d65 service glance] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:44.734838 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9c99-9296-45ff-9478-3e278ba26d65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:44.745002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9c99-9296-45ff-9478-3e278ba26d65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:44.746670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9c99-9296-45ff-9478-3e278ba26d65 service glance] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:44.761496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 996/1968] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:45.022795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.024991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:45.051222 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb4660-1fee-4fd1-b699-e6444c04dc5a service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.056573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.062997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.063448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.063741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] PATH_INFO: `/v3/projects/d6c5840b41be4b50a2cb9693aef303d0` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.065379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c5840b41be4b50a2cb9693aef303d0)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.067495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.186360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c5840b41be4b50a2cb9693aef303d0', 'request_id': 'req-a594c901-cefc-410e-a99c-4360783b76bb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.192937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c5840b41be4b50a2cb9693aef303d0', 'request_id': 'req-a594c901-cefc-410e-a99c-4360783b76bb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.200962 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c5840b41be4b50a2cb9693aef303d0', 'request_id': 'req-a594c901-cefc-410e-a99c-4360783b76bb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.214933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] The token cache is being invalidate because project d6c5840b41be4b50a2cb9693aef303d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:45.215378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.216811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a594c901-cefc-410e-a99c-4360783b76bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.218653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 973/1969] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:45 2022] DELETE /identity/v3/projects/d6c5840b41be4b50a2cb9693aef303d0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:45.224431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339aad5-d786-49b2-9f8d-aea2e03cd1b8 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.224431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339aad5-d786-49b2-9f8d-aea2e03cd1b8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.224820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339aad5-d786-49b2-9f8d-aea2e03cd1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.247912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-9339aad5-d786-49b2-9f8d-aea2e03cd1b8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:45.249275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9339aad5-d786-49b2-9f8d-aea2e03cd1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:45.294966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:45.340239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 997/1970] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:45.349389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b901-9a1e-4336-84d2-1f94e7a2682b None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.349775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b901-9a1e-4336-84d2-1f94e7a2682b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.350242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37b901-9a1e-4336-84d2-1f94e7a2682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.378025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-de37b901-9a1e-4336-84d2-1f94e7a2682b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:45.382027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-de37b901-9a1e-4336-84d2-1f94e7a2682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:45.397803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 974/1971] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:45.401900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339aad5-d786-49b2-9f8d-aea2e03cd1b8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.417070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339aad5-d786-49b2-9f8d-aea2e03cd1b8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.426072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.426647 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.426893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.427353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.427815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:45.428111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.429751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.463699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 998/1972] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:45.468337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b901-9a1e-4336-84d2-1f94e7a2682b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.496493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37b901-9a1e-4336-84d2-1f94e7a2682b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.512226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.512226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.512226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.512885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.513793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.516161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.557177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 975/1973] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:45 2022] POST /identity/v3/projects => generated 361 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:45.561074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.572954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783599-7c33-4918-86ea-90d7a03230a2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.650833 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.651546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.651929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.652209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.652918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.654887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.681759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 999/1974] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:45 2022] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:45.686443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.699820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b437d-ba5d-45be-8f73-8e9365bdf291 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.704938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.705554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.706060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.706334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.707521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.709396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.711091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:45.725457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 976/1975] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:45.726656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.728960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.729158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:45.741009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37c285-3351-4637-ad11-d74583d4bcd3 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.743678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a710-3b43-4705-8b52-054a89a914de admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.746851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.747816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.748308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.748904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.749614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.749749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.750258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.750541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.750819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] PATH_INFO: `/v3/users/a2e5aedc85c5407e918c88a793ac2930` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.751355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.752122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e5aedc85c5407e918c88a793ac2930)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.754770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.764427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 977/1976] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:45.766553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:45.778189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fbacb-b719-4ce1-b7b1-f62e018b8df5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:45.783640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686770-2df9-434f-a5aa-5636c2e7a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:45.784480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686770-2df9-434f-a5aa-5636c2e7a0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.784904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686770-2df9-434f-a5aa-5636c2e7a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.785283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686770-2df9-434f-a5aa-5636c2e7a0dc admin admin] PATH_INFO: `/v3/projects/01c4dc40322b41c78d89a57c7ebd1b97/users/248df9d3a5284863aad245f0ec8f8899/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.804703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686770-2df9-434f-a5aa-5636c2e7a0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c4dc40322b41c78d89a57c7ebd1b97, user_id=248df9d3a5284863aad245f0ec8f8899, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:45.807880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686770-2df9-434f-a5aa-5636c2e7a0dc admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:45.828496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 978/1977] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:45 2022] PUT /identity/v3/projects/01c4dc40322b41c78d89a57c7ebd1b97/users/248df9d3a5284863aad245f0ec8f8899/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:45.829913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e5aedc85c5407e918c88a793ac2930'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.839997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.840282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.840587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.840732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e5aedc85c5407e918c88a793ac2930'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.841596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e5aedc85c5407e918c88a793ac2930'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.850443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e5aedc85c5407e918c88a793ac2930'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.866657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4ee3dd92-51bc-4606-9042-bddb75d6391c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e5aedc85c5407e918c88a793ac2930'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:45.869654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] MFA Rules not processed for user `248df9d3a5284863aad245f0ec8f8899`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:45.870879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:45.875146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1000/1978] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:45 2022] DELETE /identity/v3/users/a2e5aedc85c5407e918c88a793ac2930 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:45.879706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:45.879988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:45.880260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:45.901912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:45.903124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:45.925282 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:45.977270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 979/1979] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:45.981109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1001/1980] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:45.998121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.000737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.065492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.067778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.108357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fb4a-13d3-43aa-a3c4-ec9115d7dcdd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:46.154228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ca5e5-135e-481c-9ece-c6e839c69883 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:46.158882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06a9d-93b9-48d2-8efb-7e2325c1c9f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:46.159488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06a9d-93b9-48d2-8efb-7e2325c1c9f5 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.160309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06a9d-93b9-48d2-8efb-7e2325c1c9f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.160801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06a9d-93b9-48d2-8efb-7e2325c1c9f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.181023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:46.181023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.181290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.181524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.200966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:46.202486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:46.226031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 980/1981] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:46.253680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06a9d-93b9-48d2-8efb-7e2325c1c9f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:46.255129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06a9d-93b9-48d2-8efb-7e2325c1c9f5 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:46.270969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1002/1982] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:46.285948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.287404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.301812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d442c6c-bbc7-4042-84d2-50b6bdc0c830 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:46.308109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:46.308850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.309130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.309404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] PATH_INFO: `/v3/users/248df9d3a5284863aad245f0ec8f8899` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.310615 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] RBAC: Authorizing `identity:delete_user(user_id=248df9d3a5284863aad245f0ec8f8899)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:46.312911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:46.315797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:46.385016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248df9d3a5284863aad245f0ec8f8899'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.402198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248df9d3a5284863aad245f0ec8f8899'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.422009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248df9d3a5284863aad245f0ec8f8899'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.422793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248df9d3a5284863aad245f0ec8f8899'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.427450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248df9d3a5284863aad245f0ec8f8899'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.451132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 981/1983] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:46 2022] DELETE /identity/v3/users/248df9d3a5284863aad245f0ec8f8899 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:46.455931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.456479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.456479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.479162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:46.482216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.563970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.565838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.592778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1003/1984] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:46.611820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.614173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.647978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:46.689928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a89d8-fecd-4690-8d40-52df460f111b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:46.700427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:46.702468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.702762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.705019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] PATH_INFO: `/v3/users/a31d3b858fff4ec29778fd2f5b733da8` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.711101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31d3b858fff4ec29778fd2f5b733da8)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:46.718982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:46.732412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb970b-b7e4-4469-82a8-0807505a8d84 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:46.736617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:46.737549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.738248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.738622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.754268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:46.756758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:46.770628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1004/1985] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:46.771857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.773395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.788469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de50e9-b242-4194-987c-2c95cbaabada service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:46.793360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:46.794011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.794289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.794562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] PATH_INFO: `/v3/projects/8ee67f9230964b80b4c91b52366bfe28` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.794865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31d3b858fff4ec29778fd2f5b733da8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.795724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee67f9230964b80b4c91b52366bfe28)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:46.797717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:46.803103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31d3b858fff4ec29778fd2f5b733da8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.814798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31d3b858fff4ec29778fd2f5b733da8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.816535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31d3b858fff4ec29778fd2f5b733da8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.820745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d32f1a34-6e34-4ede-8d1f-d389f3eee60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31d3b858fff4ec29778fd2f5b733da8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.843671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:46.849085 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 982/1986] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:46 2022] DELETE /identity/v3/users/a31d3b858fff4ec29778fd2f5b733da8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:46.854432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.855448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.855611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.857084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee67f9230964b80b4c91b52366bfe28', 'request_id': 'req-65c97017-c760-4339-841c-55224716e4ab'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.864210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee67f9230964b80b4c91b52366bfe28', 'request_id': 'req-65c97017-c760-4339-841c-55224716e4ab'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.872845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee67f9230964b80b4c91b52366bfe28', 'request_id': 'req-65c97017-c760-4339-841c-55224716e4ab'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.880611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:46.881842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.886703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] The token cache is being invalidate because project 8ee67f9230964b80b4c91b52366bfe28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:46.887110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.887866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:46.889765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1005/1987] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:46 2022] DELETE /identity/v3/projects/8ee67f9230964b80b4c91b52366bfe28 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:46.893440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.895084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.955970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 983/1988] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:46.967848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:46.970298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:46.978852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c97017-c760-4339-841c-55224716e4ab admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:46.985866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:46.986647 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:46.986994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:46.987277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] PATH_INFO: `/v3/users/984a0fddd26548ac993ff96a5ed22318` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:46.989671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=984a0fddd26548ac993ff96a5ed22318)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:46.991685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:47.055609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984a0fddd26548ac993ff96a5ed22318'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.056093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eab943-5bfc-4615-931b-4bf2dc755dec None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:47.057706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:47.062142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:47.063088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:47.064406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:47.064736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:47.068221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984a0fddd26548ac993ff96a5ed22318'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.069157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984a0fddd26548ac993ff96a5ed22318'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.082755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:47.085068 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:47.087285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984a0fddd26548ac993ff96a5ed22318'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.096617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 984/1989] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:47.126634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984a0fddd26548ac993ff96a5ed22318'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.139890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1006/1990] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:46 2022] DELETE /identity/v3/users/984a0fddd26548ac993ff96a5ed22318 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:47.439224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:47.440895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:47.476423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838f9f0-05b3-4c30-b65a-aaa2947c3a06 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:47.589428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:47.590202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:47.590555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:47.591074 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] PATH_INFO: `/v3/projects/69fad75848d5421ea4f39b1dcc1f744c` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:47.592520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fad75848d5421ea4f39b1dcc1f744c)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:47.595681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:47.663923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:47.686053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fad75848d5421ea4f39b1dcc1f744c', 'request_id': 'req-5083c7e6-e56a-4ea7-b279-12dde7152fc8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.699475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fad75848d5421ea4f39b1dcc1f744c', 'request_id': 'req-5083c7e6-e56a-4ea7-b279-12dde7152fc8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.712936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fad75848d5421ea4f39b1dcc1f744c', 'request_id': 'req-5083c7e6-e56a-4ea7-b279-12dde7152fc8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.731891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] The token cache is being invalidate because project 69fad75848d5421ea4f39b1dcc1f744c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:47.732759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.733184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.735106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 985/1991] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:47 2022] DELETE /identity/v3/projects/69fad75848d5421ea4f39b1dcc1f744c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:47.739704 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:47.741180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:47.761584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c1d97-efd0-4fa3-8da3-fa1d567cbe8b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:47.870764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:47.871751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:47.872240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:47.872856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] PATH_INFO: `/v3/users/4b76150c6dc04a6d96ba772dd0528805` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:47.875802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b76150c6dc04a6d96ba772dd0528805)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:47.879727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:47.933685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:47.937181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:47.966072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b76150c6dc04a6d96ba772dd0528805'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.970357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c7e6-e56a-4ea7-b279-12dde7152fc8 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:47.979178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:47.981117 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:47.981539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:47.981949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] PATH_INFO: `/v3/projects/01c4dc40322b41c78d89a57c7ebd1b97` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:47.983381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c4dc40322b41c78d89a57c7ebd1b97)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:47.985754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:47.996295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b76150c6dc04a6d96ba772dd0528805'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:47.997262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b76150c6dc04a6d96ba772dd0528805'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.008637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b76150c6dc04a6d96ba772dd0528805'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.045837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b76150c6dc04a6d96ba772dd0528805'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.058985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1007/1992] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:47 2022] DELETE /identity/v3/users/4b76150c6dc04a6d96ba772dd0528805 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:48.060983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:48.063447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:48.075820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c4dc40322b41c78d89a57c7ebd1b97', 'request_id': 'req-1bffae9f-ec7e-4250-8596-8bf7daa95156'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.091842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c4dc40322b41c78d89a57c7ebd1b97', 'request_id': 'req-1bffae9f-ec7e-4250-8596-8bf7daa95156'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.100113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c4dc40322b41c78d89a57c7ebd1b97', 'request_id': 'req-1bffae9f-ec7e-4250-8596-8bf7daa95156'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.118507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] The token cache is being invalidate because project 01c4dc40322b41c78d89a57c7ebd1b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:48.118826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.120279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1bffae9f-ec7e-4250-8596-8bf7daa95156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.126753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 986/1993] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:47 2022] DELETE /identity/v3/projects/01c4dc40322b41c78d89a57c7ebd1b97 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:48.129842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173311-2558-4a03-8f7f-c3f126685fb2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.130372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173311-2558-4a03-8f7f-c3f126685fb2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.131099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173311-2558-4a03-8f7f-c3f126685fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.133954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:48.160184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c78067-a4ad-45f3-95ad-766515c4f6e8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:48.191608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c0173311-2558-4a03-8f7f-c3f126685fb2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:48.196628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c0173311-2558-4a03-8f7f-c3f126685fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:48.247008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:48.247667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.247995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.248837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] PATH_INFO: `/v3/projects/426b0e03191744f7919bf1b3ee00c4ec` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.251251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=426b0e03191744f7919bf1b3ee00c4ec)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:48.253927 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:48.356807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 987/1994] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:48.365208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426b0e03191744f7919bf1b3ee00c4ec', 'request_id': 'req-ee11f83e-bae2-462f-91e2-944a8ff7b38f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.366045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125a505-b60b-4603-9993-fc5758de8e90 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.366336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125a505-b60b-4603-9993-fc5758de8e90 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.366607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125a505-b60b-4603-9993-fc5758de8e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.373805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426b0e03191744f7919bf1b3ee00c4ec', 'request_id': 'req-ee11f83e-bae2-462f-91e2-944a8ff7b38f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.400971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426b0e03191744f7919bf1b3ee00c4ec', 'request_id': 'req-ee11f83e-bae2-462f-91e2-944a8ff7b38f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.410788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2125a505-b60b-4603-9993-fc5758de8e90 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:48.413848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2125a505-b60b-4603-9993-fc5758de8e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:48.422957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] The token cache is being invalidate because project 426b0e03191744f7919bf1b3ee00c4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:48.423321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.425886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ee11f83e-bae2-462f-91e2-944a8ff7b38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.444121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1008/1995] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:48 2022] DELETE /identity/v3/projects/426b0e03191744f7919bf1b3ee00c4ec => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:48.464179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856c6dc-ce55-4cdf-b3d6-ebf6abd2a639 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.464977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856c6dc-ce55-4cdf-b3d6-ebf6abd2a639 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.467888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856c6dc-ce55-4cdf-b3d6-ebf6abd2a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.490052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:48.509078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 988/1996] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:48.515087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125a505-b60b-4603-9993-fc5758de8e90 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:48.535506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125a505-b60b-4603-9993-fc5758de8e90 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:48.538270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f856c6dc-ce55-4cdf-b3d6-ebf6abd2a639 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:48.540613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f856c6dc-ce55-4cdf-b3d6-ebf6abd2a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:48.540885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb89a-0710-468a-8d56-b5264716d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:48.542277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb89a-0710-468a-8d56-b5264716d152 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.542677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb89a-0710-468a-8d56-b5264716d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.543961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb89a-0710-468a-8d56-b5264716d152 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.544100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb89a-0710-468a-8d56-b5264716d152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:48.544548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb89a-0710-468a-8d56-b5264716d152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:48.547021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb89a-0710-468a-8d56-b5264716d152 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:48.559983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1009/1997] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:48.562054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 989/1998] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:48.568071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856c6dc-ce55-4cdf-b3d6-ebf6abd2a639 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:48.568892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc7f1-34ae-417a-9df3-6ee12bce4972 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.569343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc7f1-34ae-417a-9df3-6ee12bce4972 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.569808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc7f1-34ae-417a-9df3-6ee12bce4972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.581670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856c6dc-ce55-4cdf-b3d6-ebf6abd2a639 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:48.592348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:48.593592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.594159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.594673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.595291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:48.599085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:48.604891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-923bc7f1-34ae-417a-9df3-6ee12bce4972 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:48.606790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-923bc7f1-34ae-417a-9df3-6ee12bce4972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:48.625747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 990/1999] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:48.630375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc7f1-34ae-417a-9df3-6ee12bce4972 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:48.652456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc7f1-34ae-417a-9df3-6ee12bce4972 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:48.662791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1010/2000] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:48 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:48.663984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:48.801326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:48.801809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.802117 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.802406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.803073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:48.803538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:48.813092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:48.830085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:48.834059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 991/2001] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:48.835470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:48.837484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:48.853714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691aac4-a2b0-41b3-9b74-889e6f5da7e3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:48.855132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9098b-408f-4ae4-97da-aa1227940984 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:48.859822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:48.860680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.861343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.861690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:48.861887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.862696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:48.863584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:48.863814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:48.864433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] PATH_INFO: `/v3/projects/05bf1cf7a7a94c7c99e9d7b17bc59fc5` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:48.865900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bf1cf7a7a94c7c99e9d7b17bc59fc5)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:48.866259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:48.869089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:48.906818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1011/2002] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:48 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:48.907966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:48.927547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c9f4-36c2-4793-a152-d8df08bcd247 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:48.948286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bf1cf7a7a94c7c99e9d7b17bc59fc5', 'request_id': 'req-84d779a1-38e0-419e-9370-bbce1187f73d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.958055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bf1cf7a7a94c7c99e9d7b17bc59fc5', 'request_id': 'req-84d779a1-38e0-419e-9370-bbce1187f73d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:48.974880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bf1cf7a7a94c7c99e9d7b17bc59fc5', 'request_id': 'req-84d779a1-38e0-419e-9370-bbce1187f73d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:49.002626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] The token cache is being invalidate because project 05bf1cf7a7a94c7c99e9d7b17bc59fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:49.003734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:49.004647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:49.009965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 992/2003] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:48 2022] DELETE /identity/v3/projects/05bf1cf7a7a94c7c99e9d7b17bc59fc5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:49.011507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.012741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.034108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5866042-f336-4a57-8a93-0ea173800a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.035576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5866042-f336-4a57-8a93-0ea173800a6e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.036094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5866042-f336-4a57-8a93-0ea173800a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.036629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5866042-f336-4a57-8a93-0ea173800a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.037909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5866042-f336-4a57-8a93-0ea173800a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.040349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5866042-f336-4a57-8a93-0ea173800a6e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.075866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1012/2004] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:48 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:49.077179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cd8f-b9ef-46c5-ac7a-10e8b7e35520 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.077464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cd8f-b9ef-46c5-ac7a-10e8b7e35520 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.077738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cd8f-b9ef-46c5-ac7a-10e8b7e35520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.085058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:49.090559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d779a1-38e0-419e-9370-bbce1187f73d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.105525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-25f4cd8f-b9ef-46c5-ac7a-10e8b7e35520 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:49.109371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-25f4cd8f-b9ef-46c5-ac7a-10e8b7e35520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.168140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.168923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.169295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.169707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.170394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.172411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.184278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 993/2005] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:49.185147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1013/2006] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:49.185284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.186919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.189498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cd8f-b9ef-46c5-ac7a-10e8b7e35520 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.200533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cd8f-b9ef-46c5-ac7a-10e8b7e35520 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.205750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd62c-ea8f-49ff-ba2c-b0adf34de3f6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.206302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476fa1f-beb1-4e46-a8b6-37aa27837514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.212419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476fa1f-beb1-4e46-a8b6-37aa27837514 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.212419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476fa1f-beb1-4e46-a8b6-37aa27837514 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.212419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476fa1f-beb1-4e46-a8b6-37aa27837514 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.212419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476fa1f-beb1-4e46-a8b6-37aa27837514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.212419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476fa1f-beb1-4e46-a8b6-37aa27837514 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.214912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.215611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.215956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.216299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.217032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.219047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.229818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1014/2007] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:49.229818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470f6-52a9-4d49-b37f-edd2d2c2cd64 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.229818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470f6-52a9-4d49-b37f-edd2d2c2cd64 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.229818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470f6-52a9-4d49-b37f-edd2d2c2cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.247666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 994/2008] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/users => generated 287 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:49.248325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.258911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2e2470f6-52a9-4d49-b37f-edd2d2c2cd64 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:49.260307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2e2470f6-52a9-4d49-b37f-edd2d2c2cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.261225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36ef6-cdee-4d83-8cb0-72eef181651c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.266157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.267121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.267461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.267714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] PATH_INFO: `/v3/projects/1bfc72ea1ffb4337a89de12efc9185cc/users/d14e00dbb0e24f09a220901d6e0b9d30/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.269120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1015/2009] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:49.270008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2470f6-52a9-4d49-b37f-edd2d2c2cd64 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.282412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2470f6-52a9-4d49-b37f-edd2d2c2cd64 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.285271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfc72ea1ffb4337a89de12efc9185cc, user_id=d14e00dbb0e24f09a220901d6e0b9d30, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.287931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.288077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.288582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.288862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.289124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.289763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.292197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.303382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 995/2010] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:49 2022] PUT /identity/v3/projects/1bfc72ea1ffb4337a89de12efc9185cc/users/d14e00dbb0e24f09a220901d6e0b9d30/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:49.304517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.306804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1016/2011] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:49.310362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.322132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978028-285b-42d5-93e2-0be683186a33 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.359595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:49.373817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f3b9e-e22f-4605-a065-11eec71b724a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.379248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.379849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.380125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.380409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.380753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200cc84-6491-4d2c-a2cb-2b7903bee132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.381094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:49.381357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200cc84-6491-4d2c-a2cb-2b7903bee132 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.381459 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.381633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200cc84-6491-4d2c-a2cb-2b7903bee132 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.381906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200cc84-6491-4d2c-a2cb-2b7903bee132 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.382533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200cc84-6491-4d2c-a2cb-2b7903bee132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.382985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.384161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200cc84-6491-4d2c-a2cb-2b7903bee132 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.395226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1017/2012] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:49.396679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841edf36-456f-4b3c-89a5-4dcdab6f69aa None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.397143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841edf36-456f-4b3c-89a5-4dcdab6f69aa None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.397418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841edf36-456f-4b3c-89a5-4dcdab6f69aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.399706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 996/2013] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:49.400700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.410884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eee4a1-7b0e-4f86-acdc-caa597fc38ff admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.415917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.416656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.416929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.417200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] PATH_INFO: `/v3/projects/17abcde6bbb04ba5b5d02a7f5231da1f/users/f5a9ce3b6a31420a854c947d4dbca5f7/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.428222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-841edf36-456f-4b3c-89a5-4dcdab6f69aa None None] MFA Rules not processed for user `d14e00dbb0e24f09a220901d6e0b9d30`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:49.429472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-841edf36-456f-4b3c-89a5-4dcdab6f69aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.433010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] RBAC: Authorizing `identity:create_grant(project_id=17abcde6bbb04ba5b5d02a7f5231da1f, user_id=f5a9ce3b6a31420a854c947d4dbca5f7, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.435685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.448701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 997/2014] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:49 2022] PUT /identity/v3/projects/17abcde6bbb04ba5b5d02a7f5231da1f/users/f5a9ce3b6a31420a854c947d4dbca5f7/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:49.449474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.479669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:49.498179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1018/2015] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:49.499690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.500137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.500426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.517462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeba7d7-d50e-439f-a5f2-7340ee9297be admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.522726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:49.522866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.523370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.523647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.523919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.524214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.524602 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.526480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.532238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1019/2016] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:49.536246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.536246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.554962 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 998/2017] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:49.555929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.561204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.607177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8bef-f4a1-4914-9ded-7c193c8f1624 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.625146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236b9d-3a9a-473e-aece-70f5f5d535a0 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.629397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.629995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.630266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.630528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.657138 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.657774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.658047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.658316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.690739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.692285 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.695873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:49.702541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 999/2018] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:49.703153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.714610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3cb81-4ed9-48f1-a83d-d9c0778fb63d service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.721061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.721632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.721911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.722353 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.723014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.724846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.726074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.727744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.739588 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1020/2019] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:49.760432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1000/2020] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/users => generated 301 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:49.761853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.780830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759833b8-1d47-4baa-870e-4f173fe39624 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.789280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.789993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.790368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.790708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.791421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.793152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.810453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1021/2021] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:49.811938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.824960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13eae-ab58-46db-b44e-00ceaf823c44 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.830767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c74be-cf20-4dd5-9c4b-1f538a4844d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.831486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c74be-cf20-4dd5-9c4b-1f538a4844d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.831876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c74be-cf20-4dd5-9c4b-1f538a4844d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.832219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c74be-cf20-4dd5-9c4b-1f538a4844d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.832970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c74be-cf20-4dd5-9c4b-1f538a4844d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.834641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c74be-cf20-4dd5-9c4b-1f538a4844d5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.851149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1001/2022] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:49.852132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:49.864470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80459fc1-903d-4d5e-9d99-692fce964ec4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:49.869354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:49.870048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.870329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.870611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] PATH_INFO: `/v3/projects/fc4b9c49eabb405db345cfc3b5904eaf/users/afe7b30ae8b140a2976e7e810868e4d8/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.888376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4b9c49eabb405db345cfc3b5904eaf, user_id=afe7b30ae8b140a2976e7e810868e4d8, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:49.892160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:49.911132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1022/2023] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:49 2022] PUT /identity/v3/projects/fc4b9c49eabb405db345cfc3b5904eaf/users/afe7b30ae8b140a2976e7e810868e4d8/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:49.922590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336c746-786e-4086-91ed-41f5b3bb9c1d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:49.922957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336c746-786e-4086-91ed-41f5b3bb9c1d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:49.923129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336c746-786e-4086-91ed-41f5b3bb9c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:49.957375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7336c746-786e-4086-91ed-41f5b3bb9c1d None None] MFA Rules not processed for user `afe7b30ae8b140a2976e7e810868e4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:49.958714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7336c746-786e-4086-91ed-41f5b3bb9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:49.995727 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:50.097882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1002/2024] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:50.104286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.259967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c96b8-2813-4a13-9408-532880660199 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.268527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.269912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.270560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.271365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.272536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.274699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.313584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1023/2025] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:50 2022] POST /identity/v3/projects => generated 401 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:50.315262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336c746-786e-4086-91ed-41f5b3bb9c1d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.330887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336c746-786e-4086-91ed-41f5b3bb9c1d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.404798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.405416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.405694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.405963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.406642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.408598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.432771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1003/2026] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:50 2022] POST /identity/v3/users => generated 307 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:50.434022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.445656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4039416-6c2f-4af7-92ce-385fb5130b34 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.450365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cae1b-2afe-4365-a6ae-226da89a6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.450974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cae1b-2afe-4365-a6ae-226da89a6856 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.451374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cae1b-2afe-4365-a6ae-226da89a6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.451706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cae1b-2afe-4365-a6ae-226da89a6856 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.452482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cae1b-2afe-4365-a6ae-226da89a6856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.454089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cae1b-2afe-4365-a6ae-226da89a6856 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.464767 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1024/2027] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:50.468998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.480177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab829f-fe88-46e9-81ce-7004d9421b7d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.484985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.485656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.485935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.486206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] PATH_INFO: `/v3/projects/7acd054df1be4be9975a3a19e2f472c6/users/c50369b018bf4cad8a927f04829d8566/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.504730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acd054df1be4be9975a3a19e2f472c6, user_id=c50369b018bf4cad8a927f04829d8566, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.510189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.534221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1004/2028] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:50 2022] PUT /identity/v3/projects/7acd054df1be4be9975a3a19e2f472c6/users/c50369b018bf4cad8a927f04829d8566/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:50.539287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e1cf-00e4-413a-b9ab-61c6c1febd90 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.539570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e1cf-00e4-413a-b9ab-61c6c1febd90 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.539867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e1cf-00e4-413a-b9ab-61c6c1febd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.541406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.573152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-04c9e1cf-00e4-413a-b9ab-61c6c1febd90 None None] MFA Rules not processed for user `f5a9ce3b6a31420a854c947d4dbca5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:50.574684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-04c9e1cf-00e4-413a-b9ab-61c6c1febd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:50.613722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30497a62-4a6c-461d-bc0a-7a09e988973c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.618707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.620215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.620620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.621051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.621959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.623933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.635446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1005/2029] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:50.640065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.649519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:50.658498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b863c26-f7a4-44a9-852c-e6cfd5bce36b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.663288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1025/2030] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:50.665141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338244ec-67cf-4639-a37e-23585931628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.665893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338244ec-67cf-4639-a37e-23585931628c admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.666134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338244ec-67cf-4639-a37e-23585931628c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.666396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338244ec-67cf-4639-a37e-23585931628c admin admin] PATH_INFO: `/v3/projects/7acd054df1be4be9975a3a19e2f472c6/users/c50369b018bf4cad8a927f04829d8566/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.666938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e1cf-00e4-413a-b9ab-61c6c1febd90 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.669013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338244ec-67cf-4639-a37e-23585931628c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acd054df1be4be9975a3a19e2f472c6, user_id=c50369b018bf4cad8a927f04829d8566, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.671708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338244ec-67cf-4639-a37e-23585931628c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.681332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e1cf-00e4-413a-b9ab-61c6c1febd90 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.683955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1006/2031] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:50 2022] PUT /identity/v3/projects/7acd054df1be4be9975a3a19e2f472c6/users/c50369b018bf4cad8a927f04829d8566/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:50.694398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15caf-dab7-41b3-a900-42332ec1335f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.694686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15caf-dab7-41b3-a900-42332ec1335f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.694960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15caf-dab7-41b3-a900-42332ec1335f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.720807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:50.730817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-9bc15caf-dab7-41b3-a900-42332ec1335f None None] MFA Rules not processed for user `c50369b018bf4cad8a927f04829d8566`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:50.735471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9bc15caf-dab7-41b3-a900-42332ec1335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:50.751477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.752138 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.752449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.752755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.753984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.755971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.783516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1026/2032] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:50 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:50.787795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.829987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1007/2033] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:50 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:30:50.850005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc15caf-dab7-41b3-a900-42332ec1335f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.867020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e80ba9-307d-428b-9c13-8749b593051e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.872204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.873277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.873620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.873959 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.877559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.877808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.908429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1027/2034] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:50 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:50.911210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.915597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc15caf-dab7-41b3-a900-42332ec1335f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.921863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3bc56-12e6-4b6f-b728-eaf4ce6e2ebd admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.927204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.927849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.928206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.928517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.929158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:50.930776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:50.954105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1028/2035] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:50.957386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:50.971822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece7646-2f0b-43de-9c87-43dff55abca7 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:50.973307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.974004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.974370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.974715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:50.980280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:50.981289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:50.981637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:50.981983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] PATH_INFO: `/v3/projects/b39093f8fbe940d38c24b9ff0111afab/users/2a41f1fd1a794788b87393706ef5c200/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:51.000221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39093f8fbe940d38c24b9ff0111afab, user_id=2a41f1fd1a794788b87393706ef5c200, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:51.004293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:51.020870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1029/2036] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:50 2022] PUT /identity/v3/projects/b39093f8fbe940d38c24b9ff0111afab/users/2a41f1fd1a794788b87393706ef5c200/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:51.028430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:51.052723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:51.054186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:51.065185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1008/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:50 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:51.080952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:51.110228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020482-8dcd-406b-8bf4-a5b8eafdbf06 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:51.118731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:51.119752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:51.120336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:51.120336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:51.121655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:51.124444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:51.142572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1030/2038] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:51.146770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:51.152659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:51.159385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e28e-a5c9-4d82-bc94-954d5f17c242 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:51.160947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:51.164824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67b21-997e-4248-823b-698ffcacf441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:51.165869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67b21-997e-4248-823b-698ffcacf441 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:51.166531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67b21-997e-4248-823b-698ffcacf441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:51.166531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67b21-997e-4248-823b-698ffcacf441 admin admin] PATH_INFO: `/v3/projects/b39093f8fbe940d38c24b9ff0111afab/users/2a41f1fd1a794788b87393706ef5c200/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:51.169344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67b21-997e-4248-823b-698ffcacf441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39093f8fbe940d38c24b9ff0111afab, user_id=2a41f1fd1a794788b87393706ef5c200, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:51.172069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67b21-997e-4248-823b-698ffcacf441 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:51.183806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1009/2039] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:51 2022] PUT /identity/v3/projects/b39093f8fbe940d38c24b9ff0111afab/users/2a41f1fd1a794788b87393706ef5c200/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:51.226144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd02152-cda7-48e6-bce2-c8a8c41f7847 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:51.345145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693906b5-3f4e-4c05-aad2-0854cd1fe772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:51.346372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693906b5-3f4e-4c05-aad2-0854cd1fe772 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:51.346648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693906b5-3f4e-4c05-aad2-0854cd1fe772 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:51.349868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693906b5-3f4e-4c05-aad2-0854cd1fe772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:51.493491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693906b5-3f4e-4c05-aad2-0854cd1fe772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:51.496850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693906b5-3f4e-4c05-aad2-0854cd1fe772 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:51.515156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1031/2040] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:51 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:30:52.281055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:52.281550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:52.281661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:52.312104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] MFA Rules not processed for user `2a41f1fd1a794788b87393706ef5c200`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:52.313694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:52.407224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1010/2041] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:52.418407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197b48-35b9-4900-85c0-eb71a1320930 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:52.418886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197b48-35b9-4900-85c0-eb71a1320930 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:52.419125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197b48-35b9-4900-85c0-eb71a1320930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:52.439561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-16197b48-35b9-4900-85c0-eb71a1320930 None None] MFA Rules not processed for user `f5a9ce3b6a31420a854c947d4dbca5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:52.440921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-16197b48-35b9-4900-85c0-eb71a1320930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:52.491006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:52.507002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1032/2042] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:52.519014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:52.520546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:52.597131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa6506-387a-4652-bb38-523ab85e377e None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:52.602821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9226cd5-4071-4350-97f9-bc07c0ffc69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:52.603702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226cd5-4071-4350-97f9-bc07c0ffc69b service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:52.604057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226cd5-4071-4350-97f9-bc07c0ffc69b service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:52.604272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226cd5-4071-4350-97f9-bc07c0ffc69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:52.612064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9226cd5-4071-4350-97f9-bc07c0ffc69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:52.614187 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9226cd5-4071-4350-97f9-bc07c0ffc69b service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:52.622860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1011/2043] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:56.131850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197b48-35b9-4900-85c0-eb71a1320930 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:56.266367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197b48-35b9-4900-85c0-eb71a1320930 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:56.271977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:56.273207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:56.273487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:56.273755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] PATH_INFO: `/v3/users/afe7b30ae8b140a2976e7e810868e4d8` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:56.275769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe7b30ae8b140a2976e7e810868e4d8)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:56.284515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:56.353144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe7b30ae8b140a2976e7e810868e4d8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:56.369168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe7b30ae8b140a2976e7e810868e4d8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:56.369977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe7b30ae8b140a2976e7e810868e4d8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:56.380683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe7b30ae8b140a2976e7e810868e4d8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:56.401418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe7b30ae8b140a2976e7e810868e4d8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:56.410520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1033/2044] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:56 2022] DELETE /identity/v3/users/afe7b30ae8b140a2976e7e810868e4d8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:56.415238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:56.415784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:56.415903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:56.437631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:56.438942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:56.512203 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:56.528730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1012/2045] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:56.557733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:56.559297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:56.651160 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01118f9d-aefc-4a12-b1df-617fae9ca611 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:56.655291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:56.655974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:56.656966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:56.657283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:56.669940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:56.671493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:56.686121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1034/2046] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:30:57.551795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:57.554140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:57.574855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe69a0-835e-43ad-aa7e-e04a46167748 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:57.591831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:57.592891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:57.593329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:57.593792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] PATH_INFO: `/v3/projects/fc4b9c49eabb405db345cfc3b5904eaf` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:57.595094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4b9c49eabb405db345cfc3b5904eaf)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:57.597823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:57.670637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4b9c49eabb405db345cfc3b5904eaf', 'request_id': 'req-486f13f1-657f-4e94-91e9-df9f2fa4d338'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.679813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4b9c49eabb405db345cfc3b5904eaf', 'request_id': 'req-486f13f1-657f-4e94-91e9-df9f2fa4d338'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.689524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4b9c49eabb405db345cfc3b5904eaf', 'request_id': 'req-486f13f1-657f-4e94-91e9-df9f2fa4d338'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.708976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] The token cache is being invalidate because project fc4b9c49eabb405db345cfc3b5904eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:57.709520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.710434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.715823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1013/2047] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:57 2022] DELETE /identity/v3/projects/fc4b9c49eabb405db345cfc3b5904eaf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:57.719994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:57.733693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5726a-0496-45b1-884d-ec2890a34143 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:57.744016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:57.828679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:57.829390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:57.829737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:57.830076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] PATH_INFO: `/v3/users/c50369b018bf4cad8a927f04829d8566` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:57.832068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50369b018bf4cad8a927f04829d8566)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:57.834255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:57.903110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50369b018bf4cad8a927f04829d8566'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.911472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50369b018bf4cad8a927f04829d8566'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.912161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50369b018bf4cad8a927f04829d8566'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.920086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50369b018bf4cad8a927f04829d8566'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.934377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-082341eb-8956-444b-a53f-db2010323e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50369b018bf4cad8a927f04829d8566'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:57.943826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1035/2048] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:30:57 2022] DELETE /identity/v3/users/c50369b018bf4cad8a927f04829d8566 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:58.315303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:58.317652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:58.342282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f13f1-657f-4e94-91e9-df9f2fa4d338 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:58.499349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:58.501660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:58.512412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:58.512412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] PATH_INFO: `/v3/projects/7acd054df1be4be9975a3a19e2f472c6` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:58.512412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acd054df1be4be9975a3a19e2f472c6)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:58.512412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:58.569353 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acd054df1be4be9975a3a19e2f472c6', 'request_id': 'req-2ef58ed1-2f91-4164-8233-dc34e682db79'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:58.579861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acd054df1be4be9975a3a19e2f472c6', 'request_id': 'req-2ef58ed1-2f91-4164-8233-dc34e682db79'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:58.586839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acd054df1be4be9975a3a19e2f472c6', 'request_id': 'req-2ef58ed1-2f91-4164-8233-dc34e682db79'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:58.620076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] The token cache is being invalidate because project 7acd054df1be4be9975a3a19e2f472c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:30:58.620620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:58.621627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ef58ed1-2f91-4164-8233-dc34e682db79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:30:58.627988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1014/2049] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:30:58 2022] DELETE /identity/v3/projects/7acd054df1be4be9975a3a19e2f472c6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:58.630279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e0ede-5d65-46b2-8f44-1bb0edaeeff7 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:58.630628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e0ede-5d65-46b2-8f44-1bb0edaeeff7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:58.630930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e0ede-5d65-46b2-8f44-1bb0edaeeff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:58.672226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c60e0ede-5d65-46b2-8f44-1bb0edaeeff7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:58.674255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c60e0ede-5d65-46b2-8f44-1bb0edaeeff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:58.750483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1036/2050] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:58.754721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65a8f-d061-48c8-867a-e83014596327 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:58.755052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65a8f-d061-48c8-867a-e83014596327 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:58.755245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65a8f-d061-48c8-867a-e83014596327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:58.777977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-8ac65a8f-d061-48c8-867a-e83014596327 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:58.779369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8ac65a8f-d061-48c8-867a-e83014596327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:58.794267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1015/2051] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:58.798236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e0ede-5d65-46b2-8f44-1bb0edaeeff7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:58.811147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e0ede-5d65-46b2-8f44-1bb0edaeeff7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:58.817223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:58.817900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:58.818271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:58.818633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:58.819390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:30:58.820171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:58.821530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:58.846777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1037/2052] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:30:58.851140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac65a8f-d061-48c8-867a-e83014596327 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:58.867332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac65a8f-d061-48c8-867a-e83014596327 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:58.891365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:58.892941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:58.893371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:58.893905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:58.897209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:58.899245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:58.915063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:58.956731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1016/2053] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:58 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:58.965125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:58.981739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f57690-c858-4736-ba2e-66f285b9ff48 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.031405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:59.139011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.140040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.141535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.142054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.142938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.145827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.191422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1038/2054] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:58 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:59.194527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.211933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a038f-a63e-4423-b6cf-daf1e761bffe admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.220076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.220946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.221323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.221704 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.223560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.225368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.256562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1017/2055] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:59.257182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.269438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555ea9e-7028-4f50-afe6-d2ca61a04d73 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.274001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc87f5-c1d4-4b77-ba82-8a68132d9120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.274740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc87f5-c1d4-4b77-ba82-8a68132d9120 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.275049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc87f5-c1d4-4b77-ba82-8a68132d9120 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.275321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc87f5-c1d4-4b77-ba82-8a68132d9120 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.275973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc87f5-c1d4-4b77-ba82-8a68132d9120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.277656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc87f5-c1d4-4b77-ba82-8a68132d9120 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.290568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1039/2056] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:30:59.295234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.334203 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7a25-ba22-4c66-9c47-1f183a8c07f4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.348206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.348912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.349188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.349456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] PATH_INFO: `/v3/projects/04946ec8596c42388886d2f083863ece/users/3dbe42d31ce841c4911f5f42a4f623dd/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.379725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04946ec8596c42388886d2f083863ece, user_id=3dbe42d31ce841c4911f5f42a4f623dd, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.382902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.401920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1018/2057] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:59 2022] PUT /identity/v3/projects/04946ec8596c42388886d2f083863ece/users/3dbe42d31ce841c4911f5f42a4f623dd/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:30:59.412273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053abf-b96a-4f1c-a19f-4b88ff5d2147 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.412750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053abf-b96a-4f1c-a19f-4b88ff5d2147 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.413743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053abf-b96a-4f1c-a19f-4b88ff5d2147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.447819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-80053abf-b96a-4f1c-a19f-4b88ff5d2147 None None] MFA Rules not processed for user `3dbe42d31ce841c4911f5f42a4f623dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:30:59.450022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-80053abf-b96a-4f1c-a19f-4b88ff5d2147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:30:59.537509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1040/2058] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:30:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:30:59.542471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.697159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bcebe-c2a6-4992-95d3-be52f30968c4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.703495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.704171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.704496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.704775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.705453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.709568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.744687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1019/2059] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:30:59 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:30:59.748667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053abf-b96a-4f1c-a19f-4b88ff5d2147 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.763094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053abf-b96a-4f1c-a19f-4b88ff5d2147 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.835686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.835686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.835686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.835686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.836100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.838015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.868843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1041/2060] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:30:59 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:30:59.870380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.881512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94795d3c-c78b-4f7c-a99d-cc507ad01f78 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.886280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.886943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.887147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.887416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.888049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.889713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.901075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1020/2061] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:30:59.905739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.920269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10523866-afb6-48bf-a0d2-2ea544cf999a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:30:59.930366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:30:59.931056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:30:59.931340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:30:59.931619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] PATH_INFO: `/v3/projects/01d3e3f576f945fc81ba487f3471f281/users/84e8bec214604534aa021e5a7a1bc631/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:30:59.946557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:59.950361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d3e3f576f945fc81ba487f3471f281, user_id=84e8bec214604534aa021e5a7a1bc631, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:30:59.953515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:30:59.969391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1042/2062] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:30:59 2022] PUT /identity/v3/projects/01d3e3f576f945fc81ba487f3471f281/users/84e8bec214604534aa021e5a7a1bc631/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:30:59.973606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:30:59.984595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347b10a-a79b-4c65-a916-edffc84d75fb admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:00.056562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a927157-7bd1-4ea8-a294-767ff913634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:00.057175 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a927157-7bd1-4ea8-a294-767ff913634b admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:00.057452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a927157-7bd1-4ea8-a294-767ff913634b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:00.057716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a927157-7bd1-4ea8-a294-767ff913634b admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:00.058522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a927157-7bd1-4ea8-a294-767ff913634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:00.060698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a927157-7bd1-4ea8-a294-767ff913634b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:00.073107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1021/2063] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:00.077377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:00.088729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b70ae2-140d-4ebf-a4a3-59169b3f57b0 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:00.093400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:00.094072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:00.094352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:00.094623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] PATH_INFO: `/v3/projects/01d3e3f576f945fc81ba487f3471f281/users/84e8bec214604534aa021e5a7a1bc631/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:00.096574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d3e3f576f945fc81ba487f3471f281, user_id=84e8bec214604534aa021e5a7a1bc631, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:00.099882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:00.112199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1043/2064] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:00 2022] PUT /identity/v3/projects/01d3e3f576f945fc81ba487f3471f281/users/84e8bec214604534aa021e5a7a1bc631/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:00.122864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeb2af-be38-4bd8-9fe8-b8ec52291562 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:00.123164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeb2af-be38-4bd8-9fe8-b8ec52291562 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:00.123426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeb2af-be38-4bd8-9fe8-b8ec52291562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:00.154533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5cdeb2af-be38-4bd8-9fe8-b8ec52291562 None None] MFA Rules not processed for user `84e8bec214604534aa021e5a7a1bc631`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:00.155872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5cdeb2af-be38-4bd8-9fe8-b8ec52291562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:00.165639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:00.319713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1022/2065] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:00.333249 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:00.335649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:00.413091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3f335-445e-4a72-b2e2-bddac48de11c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:00.417535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0701b8-678b-4c0e-8110-729b30aac567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:00.418304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0701b8-678b-4c0e-8110-729b30aac567 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:00.418600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0701b8-678b-4c0e-8110-729b30aac567 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:00.418875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0701b8-678b-4c0e-8110-729b30aac567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:00.496066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0701b8-678b-4c0e-8110-729b30aac567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:00.497920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0701b8-678b-4c0e-8110-729b30aac567 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:00.519867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1044/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:00.803775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a25f-383e-49f3-b415-84319d194e13 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:00.805037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a25f-383e-49f3-b415-84319d194e13 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:00.805173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a25f-383e-49f3-b415-84319d194e13 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:00.807231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1023/2067] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:31:00.814800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:00.816858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:00.816858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:00.854144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:00.857716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:00.972132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1045/2068] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:31:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:00.972575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a25f-383e-49f3-b415-84319d194e13 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:00.974401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4da8a25f-383e-49f3-b415-84319d194e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:00.995124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:00.996946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:01.011443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021e888-9b73-4674-9757-1ab2ba712577 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.021183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.021924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.022474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.023021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.036368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.038826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.050664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1046/2069] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:31:01.075149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a25f-383e-49f3-b415-84319d194e13 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.080832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.081748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.082022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.082497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] PATH_INFO: `/v3/users/888e94e8319147fe8bf9b3f80dfd8bb0` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.084102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888e94e8319147fe8bf9b3f80dfd8bb0)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.087436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.139954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888e94e8319147fe8bf9b3f80dfd8bb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.149017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888e94e8319147fe8bf9b3f80dfd8bb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.157276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888e94e8319147fe8bf9b3f80dfd8bb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.158048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888e94e8319147fe8bf9b3f80dfd8bb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.159005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888e94e8319147fe8bf9b3f80dfd8bb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.178015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1024/2070] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:00 2022] DELETE /identity/v3/users/888e94e8319147fe8bf9b3f80dfd8bb0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:01.345128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.356016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b79ce8-9205-42df-ad17-90a5b75e788c service placement] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.368155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:01.415027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.416519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:01.419169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.419802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.420082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.420702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] PATH_INFO: `/v3/projects/60ed59738f11496c96bfb15ecb868560` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.421524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ed59738f11496c96bfb15ecb868560)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.423441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.430483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812831e-747b-4cf6-a3a7-cf42222b9039 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.435838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.436509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.436785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.437053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] PATH_INFO: `/v3/users/d14e00dbb0e24f09a220901d6e0b9d30` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.438160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14e00dbb0e24f09a220901d6e0b9d30)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.440060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.463199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:01.475165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ed59738f11496c96bfb15ecb868560', 'request_id': 'req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.483697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ed59738f11496c96bfb15ecb868560', 'request_id': 'req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.492719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14e00dbb0e24f09a220901d6e0b9d30'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.492874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ed59738f11496c96bfb15ecb868560', 'request_id': 'req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.500125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14e00dbb0e24f09a220901d6e0b9d30'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.507163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] The token cache is being invalidate because project 60ed59738f11496c96bfb15ecb868560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:01.507457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14e00dbb0e24f09a220901d6e0b9d30'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.508138 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.508272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14e00dbb0e24f09a220901d6e0b9d30'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.508893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3a2b1575-93c7-4394-a2c7-5a7532b0f005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14e00dbb0e24f09a220901d6e0b9d30'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.509361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8c83bc76-d3e9-4d79-93a2-0a6f7d1c2eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:01.511242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1047/2071] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:01 2022] DELETE /identity/v3/projects/60ed59738f11496c96bfb15ecb868560 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:01.517147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eee95-cf14-43b5-8ce5-bfee22be2910 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.517831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eee95-cf14-43b5-8ce5-bfee22be2910 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.519167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eee95-cf14-43b5-8ce5-bfee22be2910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.529753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1025/2072] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:01 2022] DELETE /identity/v3/users/d14e00dbb0e24f09a220901d6e0b9d30 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:31:01.536002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.536409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.536795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.546827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a51eee95-cf14-43b5-8ce5-bfee22be2910 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:01.548244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a51eee95-cf14-43b5-8ce5-bfee22be2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:01.576703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:01.579369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:01.630019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1048/2073] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:01.638504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da722fe-3813-4b7e-8c37-26b81ede07c1 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.638826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da722fe-3813-4b7e-8c37-26b81ede07c1 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.639110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da722fe-3813-4b7e-8c37-26b81ede07c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.653891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1026/2074] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:01.660056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4da722fe-3813-4b7e-8c37-26b81ede07c1 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:01.661309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4da722fe-3813-4b7e-8c37-26b81ede07c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:01.663384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.664970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:01.671581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1049/2075] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:01.676055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da722fe-3813-4b7e-8c37-26b81ede07c1 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.686161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da722fe-3813-4b7e-8c37-26b81ede07c1 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.692351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.693329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.693329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.693562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.694224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:01.694526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.696161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.709923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1050/2076] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:01.714003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.729428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdbec8-0db9-482d-97e4-d8b749e2add8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.735591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.736242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.736660 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.736934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.738537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.740652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.744813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447d68-a661-437d-bf20-09c991ff9e76 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.748958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.749580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.749855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.750124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.761092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.762524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.767616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1051/2077] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:01 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:01.771784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.772816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1027/2078] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:01.776974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:01.838700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e275-d2a1-400f-b595-1d748354c7f4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.843641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.844253 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.844566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.844841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.845477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.848015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.868808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1052/2079] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:01 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:01.872857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.884610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b3a9-e9f2-44e8-82b5-7d45656faf85 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.889244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.889828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.890320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.890586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.891214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.892950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.903635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1028/2080] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:01.907834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.919081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d324b0-1c53-418a-bb5e-eb8a1d632fd0 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.927281 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c516-dce8-40a6-9cb9-022088835413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.928097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c516-dce8-40a6-9cb9-022088835413 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.928499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c516-dce8-40a6-9cb9-022088835413 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.928990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c516-dce8-40a6-9cb9-022088835413 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.929664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c516-dce8-40a6-9cb9-022088835413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:01.931562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c516-dce8-40a6-9cb9-022088835413 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:01.944819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1053/2081] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:01.949266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:01.974577 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a3b34-9689-450e-b092-8635872fa8c2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:01.981401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:01.982144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:01.982500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:01.982847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] PATH_INFO: `/v3/projects/c6894b8e02e74ba59c44fb3f223d347e/users/bca116e3c8de4cf2aac77028c7e40a4f/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:01.999599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6894b8e02e74ba59c44fb3f223d347e, user_id=bca116e3c8de4cf2aac77028c7e40a4f, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.003904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.025186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1029/2082] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:01 2022] PUT /identity/v3/projects/c6894b8e02e74ba59c44fb3f223d347e/users/bca116e3c8de4cf2aac77028c7e40a4f/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:31:02.028996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.029610 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.030600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.053103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:02.054608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:02.114195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.115955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:02.123986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:02.183976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1054/2083] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:02.197723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.199659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:02.264440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae805f-67d6-4e31-888e-844772ec1be7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.269228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.269870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.270153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.270433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] PATH_INFO: `/v3/projects/1bfc72ea1ffb4337a89de12efc9185cc` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.271640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfc72ea1ffb4337a89de12efc9185cc)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.273762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.315390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e2d5-57e0-4c12-a8ed-0f29aec1fedf None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.331952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfc72ea1ffb4337a89de12efc9185cc', 'request_id': 'req-346c542c-676d-44e5-95ee-b662de7c0462'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:02.339766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfc72ea1ffb4337a89de12efc9185cc', 'request_id': 'req-346c542c-676d-44e5-95ee-b662de7c0462'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:02.345573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfc72ea1ffb4337a89de12efc9185cc', 'request_id': 'req-346c542c-676d-44e5-95ee-b662de7c0462'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:02.365002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] The token cache is being invalidate because project 1bfc72ea1ffb4337a89de12efc9185cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:02.365315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:02.365979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-346c542c-676d-44e5-95ee-b662de7c0462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:02.370896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1030/2084] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:02 2022] DELETE /identity/v3/projects/1bfc72ea1ffb4337a89de12efc9185cc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:31:02.372263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:02.372501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f772e9-8c35-46cc-b613-03f1131f2d10 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.372702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f772e9-8c35-46cc-b613-03f1131f2d10 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.373002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f772e9-8c35-46cc-b613-03f1131f2d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.382823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.383466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.383885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.384268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.386710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:02.395752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b2f772e9-8c35-46cc-b613-03f1131f2d10 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:02.396980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b2f772e9-8c35-46cc-b613-03f1131f2d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:02.455657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.457722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.462228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1031/2085] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:02.467617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1055/2086] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:02.470131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42084-5046-4068-ad94-df90cd718b84 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.470492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42084-5046-4068-ad94-df90cd718b84 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.470832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42084-5046-4068-ad94-df90cd718b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.491583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-63a42084-5046-4068-ad94-df90cd718b84 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:02.492988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-63a42084-5046-4068-ad94-df90cd718b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:02.502050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1032/2087] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:02.506896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.516887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c7997-018b-4f52-a10f-c98ce10e54d6 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.521655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.522361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.522640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.522983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.523973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:02.524288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.525968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.539804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1056/2088] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:02.544260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42084-5046-4068-ad94-df90cd718b84 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.554448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42084-5046-4068-ad94-df90cd718b84 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.559364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.560025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.560471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.560881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.561336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.563404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.593713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1033/2089] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:02 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:02.599040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.610079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226d03-b3ce-4f75-8ff8-4b91b606cc45 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.676239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.677490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.677490 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.677718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.678155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.680114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.705966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1057/2090] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:02 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:02.707314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.718759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afafe7-5369-4c80-bfcb-c12ae91c0099 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.725330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.725933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.726215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.726485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.727129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.729038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.730444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:02.745884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1034/2091] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:02.749460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.760768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab018aa-719a-47fe-8f36-fc47870f9d16 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.766605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d7c7b-4a69-4b0d-a7bc-2f50848af32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.767518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7c7b-4a69-4b0d-a7bc-2f50848af32e admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.767943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7c7b-4a69-4b0d-a7bc-2f50848af32e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.768499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7c7b-4a69-4b0d-a7bc-2f50848af32e admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.769297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d7c7b-4a69-4b0d-a7bc-2f50848af32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.770967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d7c7b-4a69-4b0d-a7bc-2f50848af32e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.782756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1058/2092] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:02.787989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:02.809658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abdca5-3330-4733-906c-a6891a2034a3 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:02.815487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:02.816506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.816790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.817060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] PATH_INFO: `/v3/projects/9a688be762c44de78af4ed308697dea5/users/a26978fb59a24b8898daf217df09f680/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.844681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a688be762c44de78af4ed308697dea5, user_id=a26978fb59a24b8898daf217df09f680, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:02.853702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:02.880559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1035/2093] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:02 2022] PUT /identity/v3/projects/9a688be762c44de78af4ed308697dea5/users/a26978fb59a24b8898daf217df09f680/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:02.890035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:02.890536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:02.890631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:02.939335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] MFA Rules not processed for user `a26978fb59a24b8898daf217df09f680`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:02.941729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:02.996798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:03.028640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1059/2094] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:03.040992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:03.043582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:03.114895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15d2b-c81a-4868-8648-2bd1dced1253 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:03.118906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c70b1-3e79-448d-9735-45cb0a2e9cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:03.119553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c70b1-3e79-448d-9735-45cb0a2e9cde service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:03.119832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c70b1-3e79-448d-9735-45cb0a2e9cde service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:03.120102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c70b1-3e79-448d-9735-45cb0a2e9cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:03.132108 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c70b1-3e79-448d-9735-45cb0a2e9cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:03.134022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c70b1-3e79-448d-9735-45cb0a2e9cde service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:03.157471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1036/2095] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:03.291406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:03.293043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:03.445248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010492-787f-4b2d-8fd1-caca63da0d7f None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:03.451570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:03.453026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:03.453398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:03.453746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] PATH_INFO: `/v3/users/3dbe42d31ce841c4911f5f42a4f623dd` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:03.465867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbe42d31ce841c4911f5f42a4f623dd)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:03.468137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:03.564188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbe42d31ce841c4911f5f42a4f623dd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:03.586436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbe42d31ce841c4911f5f42a4f623dd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:03.587868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbe42d31ce841c4911f5f42a4f623dd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:03.603943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbe42d31ce841c4911f5f42a4f623dd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:03.636552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbe42d31ce841c4911f5f42a4f623dd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:03.657787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1060/2096] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:03 2022] DELETE /identity/v3/users/3dbe42d31ce841c4911f5f42a4f623dd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:03.662902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:03.663291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:03.663882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:03.701014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:03.702442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:03.825349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1037/2097] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:03.835909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:03.838481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:03.912227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c446bf-1e72-4758-b898-583896e11458 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:03.916801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:03.917524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:03.918147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:03.918521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:03.931985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:03.933607 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:03.947320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1061/2098] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:04.252102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:04.253796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:04.266317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5a366-7409-4654-8829-d1a98d1548a6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:04.271177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:04.271984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:04.272750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:04.272750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] PATH_INFO: `/v3/projects/04946ec8596c42388886d2f083863ece` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:04.273809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04946ec8596c42388886d2f083863ece)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:04.275745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:04.344621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04946ec8596c42388886d2f083863ece', 'request_id': 'req-112175ef-555e-49f1-bfe0-137433c1b406'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.363133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04946ec8596c42388886d2f083863ece', 'request_id': 'req-112175ef-555e-49f1-bfe0-137433c1b406'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.376032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04946ec8596c42388886d2f083863ece', 'request_id': 'req-112175ef-555e-49f1-bfe0-137433c1b406'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.388598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:04.396052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] The token cache is being invalidate because project 04946ec8596c42388886d2f083863ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:04.396355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.397397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.399165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1038/2099] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:04 2022] DELETE /identity/v3/projects/04946ec8596c42388886d2f083863ece => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:04.403560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:04.416874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e00ec-0a04-4a1b-8eed-f221e03b62db service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:04.421501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:04.487920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:04.488605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:04.488884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:04.489289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] PATH_INFO: `/v3/users/84e8bec214604534aa021e5a7a1bc631` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:04.490608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e8bec214604534aa021e5a7a1bc631)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:04.494220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:04.495386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:04.497039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:04.511699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112175ef-555e-49f1-bfe0-137433c1b406 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:04.524824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:04.525531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:04.525814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:04.526092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] PATH_INFO: `/v3/users/ac35338a589644379a7ace40d7d450d9` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:04.527347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac35338a589644379a7ace40d7d450d9)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:04.529340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:04.564336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e8bec214604534aa021e5a7a1bc631'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.578458 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e8bec214604534aa021e5a7a1bc631'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.579287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e8bec214604534aa021e5a7a1bc631'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.593351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e8bec214604534aa021e5a7a1bc631'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.609230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7022308d-9303-4933-b69e-92a848c874f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e8bec214604534aa021e5a7a1bc631'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.620441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1062/2100] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:04 2022] DELETE /identity/v3/users/84e8bec214604534aa021e5a7a1bc631 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:04.655370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac35338a589644379a7ace40d7d450d9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.665052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac35338a589644379a7ace40d7d450d9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.675882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac35338a589644379a7ace40d7d450d9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.676609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac35338a589644379a7ace40d7d450d9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.677342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96935c3a-20e5-49ff-b5e1-2733971c30dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac35338a589644379a7ace40d7d450d9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:04.703526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1039/2101] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:04 2022] DELETE /identity/v3/users/ac35338a589644379a7ace40d7d450d9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:04.708342 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:04.708925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:04.709512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:04.740477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:04.741935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:04.876511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:04.876511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:04.876990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:04.884279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1063/2102] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:04.900158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:04.904520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:04.907825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] MFA Rules not processed for user `a26978fb59a24b8898daf217df09f680`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:04.909680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:04.963196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:05.013122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf36555-0343-416c-9ef6-01f57831845e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:05.017223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba491a52-0072-4fe8-ab91-93e07b5932d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:05.017843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491a52-0072-4fe8-ab91-93e07b5932d7 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:05.018124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491a52-0072-4fe8-ab91-93e07b5932d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:05.018434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491a52-0072-4fe8-ab91-93e07b5932d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:05.041661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba491a52-0072-4fe8-ab91-93e07b5932d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:05.043773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba491a52-0072-4fe8-ab91-93e07b5932d7 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:05.044334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1040/2103] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:05.054481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1064/2104] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:05.368896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:05.371031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:05.392692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945ff30-2e48-49db-b20a-3d11a3f46079 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:05.398970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:05.400562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:05.400963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:05.401330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] PATH_INFO: `/v3/projects/01d3e3f576f945fc81ba487f3471f281` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:05.402598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d3e3f576f945fc81ba487f3471f281)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:05.404959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:05.487426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d3e3f576f945fc81ba487f3471f281', 'request_id': 'req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:05.494237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d3e3f576f945fc81ba487f3471f281', 'request_id': 'req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:05.501098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d3e3f576f945fc81ba487f3471f281', 'request_id': 'req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:05.515603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:05.533164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] The token cache is being invalidate because project 01d3e3f576f945fc81ba487f3471f281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:05.533890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:05.536315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4b21414a-5cdb-4248-a1ee-5c1e3aa35251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:05.540375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1041/2105] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:05 2022] DELETE /identity/v3/projects/01d3e3f576f945fc81ba487f3471f281 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:05.545198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d9b38-573a-4cae-93f1-d5072deadab4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:05.545487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d9b38-573a-4cae-93f1-d5072deadab4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:05.545763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d9b38-573a-4cae-93f1-d5072deadab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:05.568042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c05d9b38-573a-4cae-93f1-d5072deadab4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:05.569223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c05d9b38-573a-4cae-93f1-d5072deadab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:05.655414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1065/2106] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:05.664352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f7b92-132f-4862-a54a-564af61ae6b1 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:05.665236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f7b92-132f-4862-a54a-564af61ae6b1 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:05.665584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f7b92-132f-4862-a54a-564af61ae6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:05.707392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-965f7b92-132f-4862-a54a-564af61ae6b1 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:05.711086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-965f7b92-132f-4862-a54a-564af61ae6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:05.728836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1042/2107] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:05.732088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d9b38-573a-4cae-93f1-d5072deadab4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:05.749154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d9b38-573a-4cae-93f1-d5072deadab4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:05.758867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:05.759526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:05.759863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:05.760207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:05.762172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:05.762717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:05.766297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:05.781483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1066/2108] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:05.786144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f7b92-132f-4862-a54a-564af61ae6b1 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:05.800932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f7b92-132f-4862-a54a-564af61ae6b1 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:05.816051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:05.817354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:05.817826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:05.818273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:05.819448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:05.823478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:05.881296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1043/2109] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:05 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:05.882012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:05.921865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660649a8-2402-441a-9a3e-58a0aa440f72 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.073810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:06.077624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:06.078878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:06.080196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.081695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.083415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.084239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:06.091546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:06.144202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1067/2110] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:05 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:06.145462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:06.154359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef081f6-61fd-4098-942d-5e829ca758f4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.169209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:06.172903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.173251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.173509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] PATH_INFO: `/v3/projects/6f52c456f58d4f05aada138caaa1b1be` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.173613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00d121-19e2-48c7-b607-389b3c759ecf admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.180119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f52c456f58d4f05aada138caaa1b1be)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:06.182261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:06.193315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:06.194214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.194538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.194880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.195718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:06.198204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:06.236931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1068/2111] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:06.249898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:06.297828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d90e7-a826-486b-ac5e-c5259f270722 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.334622 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f52c456f58d4f05aada138caaa1b1be', 'request_id': 'req-43b38d93-d83c-4822-a002-fb87bf53223a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:06.351833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f52c456f58d4f05aada138caaa1b1be', 'request_id': 'req-43b38d93-d83c-4822-a002-fb87bf53223a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:06.371936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f52c456f58d4f05aada138caaa1b1be', 'request_id': 'req-43b38d93-d83c-4822-a002-fb87bf53223a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:06.408542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] The token cache is being invalidate because project 6f52c456f58d4f05aada138caaa1b1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:06.408849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:06.410913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-43b38d93-d83c-4822-a002-fb87bf53223a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:06.417901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:06.420719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1044/2112] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:06 2022] DELETE /identity/v3/projects/6f52c456f58d4f05aada138caaa1b1be => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:06.422460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e372-1897-47fb-aa49-f13df441359d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.422746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e372-1897-47fb-aa49-f13df441359d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.423029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993e372-1897-47fb-aa49-f13df441359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.472792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4993e372-1897-47fb-aa49-f13df441359d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:06.474533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4993e372-1897-47fb-aa49-f13df441359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:06.483372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:06.485532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.485826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.486102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.486803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:06.488513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:06.516418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1045/2113] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:06.516418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1937b-989f-4899-8786-44e149cc8328 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.516418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1937b-989f-4899-8786-44e149cc8328 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.516418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1937b-989f-4899-8786-44e149cc8328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.526168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1069/2114] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:06.526168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:06.528778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:06.560028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55a9f-b4ca-4e09-a42c-b3ef1ad9cd0f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.580563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5adb5c-b344-4a0f-bd03-8c2823162c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:06.583554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5adb5c-b344-4a0f-bd03-8c2823162c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.585741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5adb5c-b344-4a0f-bd03-8c2823162c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.587027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5adb5c-b344-4a0f-bd03-8c2823162c1a admin admin] PATH_INFO: `/v3/projects/b9fd986d8c014b928df7e4e66de4d9ea/users/1bbb019a313344bf8c00a3db4897e1d0/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.587726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-94a1937b-989f-4899-8786-44e149cc8328 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:06.590376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-94a1937b-989f-4899-8786-44e149cc8328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:06.616700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1046/2115] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:06.621937 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1937b-989f-4899-8786-44e149cc8328 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:06.637611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5adb5c-b344-4a0f-bd03-8c2823162c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fd986d8c014b928df7e4e66de4d9ea, user_id=1bbb019a313344bf8c00a3db4897e1d0, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:06.648870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5adb5c-b344-4a0f-bd03-8c2823162c1a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:06.667025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1937b-989f-4899-8786-44e149cc8328 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.686165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:06.689851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.690168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.692406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.694593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1070/2116] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:06 2022] PUT /identity/v3/projects/b9fd986d8c014b928df7e4e66de4d9ea/users/1bbb019a313344bf8c00a3db4897e1d0/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:06.707003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:06.707207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38802d5-2164-4fcc-92a9-7d2226f9e86f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.707332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:06.707451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38802d5-2164-4fcc-92a9-7d2226f9e86f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.707681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38802d5-2164-4fcc-92a9-7d2226f9e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.709052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:06.728541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1047/2117] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:31:06.732747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:06.763569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6d071-4d8b-47c3-8fc0-e2301e372e64 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.777768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c38802d5-2164-4fcc-92a9-7d2226f9e86f None None] MFA Rules not processed for user `1bbb019a313344bf8c00a3db4897e1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:06.779571 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c38802d5-2164-4fcc-92a9-7d2226f9e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:06.902950 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:06.903609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:06.903922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:06.904194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:06.904910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:06.906909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:06.937746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1071/2118] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:06.944430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38802d5-2164-4fcc-92a9-7d2226f9e86f None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:06.965888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1048/2119] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:06 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:06.969376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38802d5-2164-4fcc-92a9-7d2226f9e86f None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:06.969855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.003178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:07.082288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfee18-6804-41a3-baf2-833a23501e94 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.091257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.092037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.095507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.096053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.100304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.108421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.138464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.139659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.141100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.142851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.145325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.150764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.256153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1072/2120] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:06 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:07.257343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.288431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1049/2121] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:06 2022] POST /identity/v3/users => generated 291 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:07.297779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.308449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:07.391649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f077c-f332-4aa9-8266-a87a1f18fd9c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.394099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b825d6-1281-424d-9d0b-2fc8a4d90423 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.416436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.416436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.416436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.416436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.417301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.417301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.433855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.434830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.435303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.435760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.440152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.446347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.468435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1073/2122] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:07 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:07.474172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.496196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1050/2123] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:07.506711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.512262 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a701d-2a2e-41d7-b5ff-abebdc6d2894 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.520356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.521766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.521881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.522084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.522698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.524436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.540286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8b05-3e78-4781-a16f-fecbd8c50727 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.543705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1074/2124] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:07.547419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.556631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.557431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.570771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.572457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.572907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5195-222b-4b83-bd86-140e5f78f982 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.573306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.579784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.586333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.586953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.587256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.587489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.588129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.591653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.615070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1051/2125] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:07.616631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.634620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a2320-10e9-4978-80a2-584bbc0d5f31 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.634762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1075/2126] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:07.635649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.653567 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97583d9c-3fdd-4e7e-b459-8a5a0a8c0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.656447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583d9c-3fdd-4e7e-b459-8a5a0a8c0af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.657407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583d9c-3fdd-4e7e-b459-8a5a0a8c0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.657965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583d9c-3fdd-4e7e-b459-8a5a0a8c0af8 admin admin] PATH_INFO: `/v3/projects/3a5d4bbf88da424f8a84b98603a7d57a/users/b714e26a0db64849b0d42f7c8e3db39a/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.670791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1154d6e-1acc-4aa3-851c-1c2b3532fd0b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.691509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b4a3-c1f4-40a8-a7c9-87ca27cdea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.692314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b4a3-c1f4-40a8-a7c9-87ca27cdea67 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.692676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b4a3-c1f4-40a8-a7c9-87ca27cdea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.693719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b4a3-c1f4-40a8-a7c9-87ca27cdea67 admin admin] PATH_INFO: `/v3/projects/0197d367917b4169b8c709e0619e21c9/users/0980929fbe2d4045aee43e8f9df31778/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.703204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97583d9c-3fdd-4e7e-b459-8a5a0a8c0af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5d4bbf88da424f8a84b98603a7d57a, user_id=b714e26a0db64849b0d42f7c8e3db39a, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.709063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97583d9c-3fdd-4e7e-b459-8a5a0a8c0af8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.711780 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b4a3-c1f4-40a8-a7c9-87ca27cdea67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0197d367917b4169b8c709e0619e21c9, user_id=0980929fbe2d4045aee43e8f9df31778, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.715353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b4a3-c1f4-40a8-a7c9-87ca27cdea67 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.745586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1052/2127] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:07 2022] PUT /identity/v3/projects/3a5d4bbf88da424f8a84b98603a7d57a/users/b714e26a0db64849b0d42f7c8e3db39a/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:07.749806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1076/2128] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:07 2022] PUT /identity/v3/projects/0197d367917b4169b8c709e0619e21c9/users/0980929fbe2d4045aee43e8f9df31778/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:07.763822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006591-ec85-40d8-8aff-3c3d27a41afb None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.765226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.766191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.766315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006591-ec85-40d8-8aff-3c3d27a41afb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.766521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.767112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006591-ec85-40d8-8aff-3c3d27a41afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.813861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-87006591-ec85-40d8-8aff-3c3d27a41afb None None] MFA Rules not processed for user `0980929fbe2d4045aee43e8f9df31778`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:07.816331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-87006591-ec85-40d8-8aff-3c3d27a41afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:07.824163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:07.825935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:07.937315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1077/2129] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:07.943025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006591-ec85-40d8-8aff-3c3d27a41afb None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.955057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006591-ec85-40d8-8aff-3c3d27a41afb None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:07.962253 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:07.963208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:07.963208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:07.963410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:07.963944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1053/2130] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:07.968086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:07.970436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:07.974137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:07.976804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:08.013808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1078/2131] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:07 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:08.018094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:08.097280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:08.120693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827832ef-d69f-4586-abc9-f0da4548f9ea None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:08.145971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2ad9e-f1f2-41b3-9c1e-4a12489734cc admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:08.149786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:08.159656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:08.160867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.161258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.161635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.162469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:08.168951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:08.214242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1079/2132] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:08 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:08.219101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:08.249621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:08.250249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.250671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.252530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.262441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3052a-ca00-4282-a9ae-1de0ffce1a06 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:08.265306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:08.266893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:08.280964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:08.283279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.283572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.287509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.289604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:08.290025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1054/2133] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:31:08.296352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:08.336622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1080/2134] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:08.337921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:08.350143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53f11-346d-4275-be27-59d8a488ee3a service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:08.364487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6a26-166b-4463-a987-a79a789dfcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:08.366692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6a26-166b-4463-a987-a79a789dfcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.368118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6a26-166b-4463-a987-a79a789dfcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.368969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6a26-166b-4463-a987-a79a789dfcaa admin admin] PATH_INFO: `/v3/projects/664780e0d8784f30842d58147d82c618/users/dc96ed10faaf446c866e878d5840efe6/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.407649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6a26-166b-4463-a987-a79a789dfcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=664780e0d8784f30842d58147d82c618, user_id=dc96ed10faaf446c866e878d5840efe6, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:08.415439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6a26-166b-4463-a987-a79a789dfcaa admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:08.442832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:08.443216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1055/2135] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:08 2022] PUT /identity/v3/projects/664780e0d8784f30842d58147d82c618/users/dc96ed10faaf446c866e878d5840efe6/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:08.454577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5c2a4-55fc-45a5-af46-8f46f5643fd4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:08.569619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.569941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.570423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.598369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:08.603584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.606390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.606740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.613314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:08.617558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:08.646115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1081/2136] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:31:08.650206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:08.681877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36931d39-a841-4401-8754-a91d58c7dbe9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:08.683653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] MFA Rules not processed for user `bca116e3c8de4cf2aac77028c7e40a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:08.685094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:08.686961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86e69e-9480-4a7e-9716-b48cf5308506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:08.687642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86e69e-9480-4a7e-9716-b48cf5308506 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.687925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86e69e-9480-4a7e-9716-b48cf5308506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.688200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86e69e-9480-4a7e-9716-b48cf5308506 admin admin] PATH_INFO: `/v3/projects/664780e0d8784f30842d58147d82c618/users/dc96ed10faaf446c866e878d5840efe6/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.695318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86e69e-9480-4a7e-9716-b48cf5308506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664780e0d8784f30842d58147d82c618, user_id=dc96ed10faaf446c866e878d5840efe6, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:08.698348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86e69e-9480-4a7e-9716-b48cf5308506 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:08.742375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1082/2137] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:08 2022] PUT /identity/v3/projects/664780e0d8784f30842d58147d82c618/users/dc96ed10faaf446c866e878d5840efe6/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:08.743623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:08.743954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:08.744235 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:08.811664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] MFA Rules not processed for user `dc96ed10faaf446c866e878d5840efe6`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:08.814513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:08.837673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1056/2138] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:08.857081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:08.860360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:09.038738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1083/2139] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:09.039705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:09.049460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:09.085298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537c119-ff97-44b1-957e-b60d06ad82fa None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:09.113030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:09.147663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:09.188141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c47e-2144-4c3e-860b-860bc59f062d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:09.193428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:09.194148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:09.194828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:09.194828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:09.196671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:09.234338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6875fc-6eff-41a9-bcbe-5afa1916e81d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:09.235415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6875fc-6eff-41a9-bcbe-5afa1916e81d service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:09.235923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6875fc-6eff-41a9-bcbe-5afa1916e81d service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:09.236779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6875fc-6eff-41a9-bcbe-5afa1916e81d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:09.316980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:09.318617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:09.329692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6875fc-6eff-41a9-bcbe-5afa1916e81d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:09.331189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1084/2140] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:09.331445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6875fc-6eff-41a9-bcbe-5afa1916e81d service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:09.332057 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:09.333440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:09.347923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe411c-4b23-4535-b0d4-7e2010789ded service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:09.352539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:09.355436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:09.355799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:09.356188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:09.360182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1057/2141] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:31:09.459351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:09.461584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:09.483693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1085/2142] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:10.205278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9cbf-b233-4280-aecb-7e8e11948b32 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:10.205750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9cbf-b233-4280-aecb-7e8e11948b32 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:10.206284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9cbf-b233-4280-aecb-7e8e11948b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:10.308157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-813e9cbf-b233-4280-aecb-7e8e11948b32 None None] MFA Rules not processed for user `b714e26a0db64849b0d42f7c8e3db39a`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:10.309466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-813e9cbf-b233-4280-aecb-7e8e11948b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:10.473717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1058/2143] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:10.484039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:10.503455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8464-9735-4767-9f96-589ae4c3936d service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:10.513686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58039d-df11-48ab-99ac-e936963ab454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:10.514578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58039d-df11-48ab-99ac-e936963ab454 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:10.514868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58039d-df11-48ab-99ac-e936963ab454 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:10.515191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58039d-df11-48ab-99ac-e936963ab454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:10.539826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58039d-df11-48ab-99ac-e936963ab454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:10.541410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58039d-df11-48ab-99ac-e936963ab454 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:10.570000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1086/2144] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:11.415333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9cbf-b233-4280-aecb-7e8e11948b32 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:11.425553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9cbf-b233-4280-aecb-7e8e11948b32 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:11.429126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816a29f-0906-4e91-b042-58efcd8cfb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:11.429725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816a29f-0906-4e91-b042-58efcd8cfb9a service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:11.429999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816a29f-0906-4e91-b042-58efcd8cfb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:11.430268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816a29f-0906-4e91-b042-58efcd8cfb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:11.481300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:11.501546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816a29f-0906-4e91-b042-58efcd8cfb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:11.503153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816a29f-0906-4e91-b042-58efcd8cfb9a service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:11.521976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1059/2145] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:11.914342 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa369-d4a7-4c49-9750-6926a371ddfc None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:11.914897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa369-d4a7-4c49-9750-6926a371ddfc None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:11.915158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa369-d4a7-4c49-9750-6926a371ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:11.941478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d56aa369-d4a7-4c49-9750-6926a371ddfc None None] MFA Rules not processed for user `bca116e3c8de4cf2aac77028c7e40a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:11.943578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d56aa369-d4a7-4c49-9750-6926a371ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:11.954255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1087/2146] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:12.298934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d47a-1bc4-4b97-b36f-26e0630109ed None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:12.299314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d47a-1bc4-4b97-b36f-26e0630109ed None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:12.299505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d47a-1bc4-4b97-b36f-26e0630109ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:12.329053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa369-d4a7-4c49-9750-6926a371ddfc None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:12.331968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1aa3d47a-1bc4-4b97-b36f-26e0630109ed None None] MFA Rules not processed for user `b714e26a0db64849b0d42f7c8e3db39a`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:12.333270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1aa3d47a-1bc4-4b97-b36f-26e0630109ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:12.345199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa369-d4a7-4c49-9750-6926a371ddfc None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:12.345743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1060/2147] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:12.355206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fdb08-f274-49a7-a0ad-1333b18e2b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:12.355912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdb08-f274-49a7-a0ad-1333b18e2b22 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:12.356257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdb08-f274-49a7-a0ad-1333b18e2b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:12.356614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdb08-f274-49a7-a0ad-1333b18e2b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:12.381314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fdb08-f274-49a7-a0ad-1333b18e2b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:12.382983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fdb08-f274-49a7-a0ad-1333b18e2b22 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:12.400511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1088/2148] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:16.643278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3d47a-1bc4-4b97-b36f-26e0630109ed None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:16.766247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3d47a-1bc4-4b97-b36f-26e0630109ed None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:16.771966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:16.772725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:16.773013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:16.773287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] PATH_INFO: `/v3/users/1bbb019a313344bf8c00a3db4897e1d0` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:16.774747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbb019a313344bf8c00a3db4897e1d0)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:16.778519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:16.904907 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbb019a313344bf8c00a3db4897e1d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:16.924813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbb019a313344bf8c00a3db4897e1d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:16.942683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbb019a313344bf8c00a3db4897e1d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:16.944031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbb019a313344bf8c00a3db4897e1d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:16.944792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbb019a313344bf8c00a3db4897e1d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:16.998259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1061/2149] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:16 2022] DELETE /identity/v3/users/1bbb019a313344bf8c00a3db4897e1d0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:17.000654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:17.001538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:17.002123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:17.030514 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:17.032168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:17.080823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:17.115729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1089/2150] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:17.126251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:17.128283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:17.197669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd0254-c816-457b-b132-8519630fb8ef admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:17.201665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:17.202274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:17.202555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:17.202947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:17.213486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:17.215198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:17.219725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:17.240465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1062/2151] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:17.693879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:17.696523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:17.710280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee43f-6778-4922-b730-9c8a31d2edcc None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:17.737742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:17.739011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:17.741093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:17.741645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] PATH_INFO: `/v3/projects/b9fd986d8c014b928df7e4e66de4d9ea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:17.760064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fd986d8c014b928df7e4e66de4d9ea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:17.763660 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:17.837810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fd986d8c014b928df7e4e66de4d9ea', 'request_id': 'req-c06bcd9c-98a9-47e1-adda-21ccbda649cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:17.845842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fd986d8c014b928df7e4e66de4d9ea', 'request_id': 'req-c06bcd9c-98a9-47e1-adda-21ccbda649cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:17.855316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fd986d8c014b928df7e4e66de4d9ea', 'request_id': 'req-c06bcd9c-98a9-47e1-adda-21ccbda649cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:17.867234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] The token cache is being invalidate because project b9fd986d8c014b928df7e4e66de4d9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:17.867934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:17.868871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:17.870894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1090/2152] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:17 2022] DELETE /identity/v3/projects/b9fd986d8c014b928df7e4e66de4d9ea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:17.875579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:17.887248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986ad3-1488-49a2-8e2b-9bf8b4ade6e2 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:18.042054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:18.042954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:18.043549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:18.044038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] PATH_INFO: `/v3/users/0980929fbe2d4045aee43e8f9df31778` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:18.048202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0980929fbe2d4045aee43e8f9df31778)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:18.055401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:18.138878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0980929fbe2d4045aee43e8f9df31778'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:18.164841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0980929fbe2d4045aee43e8f9df31778'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:18.184065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0980929fbe2d4045aee43e8f9df31778'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:18.185133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0980929fbe2d4045aee43e8f9df31778'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:18.185903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0980929fbe2d4045aee43e8f9df31778'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:18.214893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1063/2153] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:17 2022] DELETE /identity/v3/users/0980929fbe2d4045aee43e8f9df31778 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:19.149507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:19.152066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:19.168513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bcd9c-98a9-47e1-adda-21ccbda649cf admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:19.276700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:19.277622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:19.278053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:19.278471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] PATH_INFO: `/v3/projects/0197d367917b4169b8c709e0619e21c9` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:19.280180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0197d367917b4169b8c709e0619e21c9)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:19.282369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:19.422680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0197d367917b4169b8c709e0619e21c9', 'request_id': 'req-c74eab0c-2246-4663-967f-a8ffac9c854e'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.442414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0197d367917b4169b8c709e0619e21c9', 'request_id': 'req-c74eab0c-2246-4663-967f-a8ffac9c854e'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.458480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0197d367917b4169b8c709e0619e21c9', 'request_id': 'req-c74eab0c-2246-4663-967f-a8ffac9c854e'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.466026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:19.498360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] The token cache is being invalidate because project 0197d367917b4169b8c709e0619e21c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:19.502268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.519349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.521227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1091/2154] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:19 2022] DELETE /identity/v3/projects/0197d367917b4169b8c709e0619e21c9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:19.525049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:19.527362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:19.546839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ac943-e8a5-4926-b7a6-bfa9160cf171 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:19.660687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:19.661464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:19.661847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:19.662410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] PATH_INFO: `/v3/users/dc96ed10faaf446c866e878d5840efe6` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:19.664182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc96ed10faaf446c866e878d5840efe6)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:19.666845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:19.693370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:19.742887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc96ed10faaf446c866e878d5840efe6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.757156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc96ed10faaf446c866e878d5840efe6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.778351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc96ed10faaf446c866e878d5840efe6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.779815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc96ed10faaf446c866e878d5840efe6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.780886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d153e820-a42a-4bae-b34a-77c51baad3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc96ed10faaf446c866e878d5840efe6'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:19.808528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1064/2155] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:19 2022] DELETE /identity/v3/users/dc96ed10faaf446c866e878d5840efe6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:20.451821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:20.453370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:20.468090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eab0c-2246-4663-967f-a8ffac9c854e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:20.555019 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:20.555683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:20.555962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:20.556229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] PATH_INFO: `/v3/projects/664780e0d8784f30842d58147d82c618` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:20.557385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664780e0d8784f30842d58147d82c618)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:20.559264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:20.619168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664780e0d8784f30842d58147d82c618', 'request_id': 'req-d2e4dd1f-3a15-4263-8c33-5486deff7be2'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:20.627010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664780e0d8784f30842d58147d82c618', 'request_id': 'req-d2e4dd1f-3a15-4263-8c33-5486deff7be2'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:20.645987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664780e0d8784f30842d58147d82c618', 'request_id': 'req-d2e4dd1f-3a15-4263-8c33-5486deff7be2'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:20.660290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] The token cache is being invalidate because project 664780e0d8784f30842d58147d82c618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:20.660975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:20.662002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d2e4dd1f-3a15-4263-8c33-5486deff7be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:20.664358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1092/2156] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:20 2022] DELETE /identity/v3/projects/664780e0d8784f30842d58147d82c618 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:20.669199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531de72-1c13-4eb3-8580-d7d7149bc6c4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:20.670350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531de72-1c13-4eb3-8580-d7d7149bc6c4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:20.670832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531de72-1c13-4eb3-8580-d7d7149bc6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:20.698062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e531de72-1c13-4eb3-8580-d7d7149bc6c4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:20.700154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e531de72-1c13-4eb3-8580-d7d7149bc6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:20.771570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1065/2157] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:20.781597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58cd53-49ce-40f8-97f3-5d9819d8b3ba None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:20.781975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58cd53-49ce-40f8-97f3-5d9819d8b3ba None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:20.782339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58cd53-49ce-40f8-97f3-5d9819d8b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:20.847164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7e58cd53-49ce-40f8-97f3-5d9819d8b3ba None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:20.851749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7e58cd53-49ce-40f8-97f3-5d9819d8b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:20.888843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1093/2158] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:20.892729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531de72-1c13-4eb3-8580-d7d7149bc6c4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:20.907943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531de72-1c13-4eb3-8580-d7d7149bc6c4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:20.913874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:20.914559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:20.914908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:20.915248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:20.917759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:20.917759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:20.918394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:20.944423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58cd53-49ce-40f8-97f3-5d9819d8b3ba None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:20.946749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1066/2159] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:20.953345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58cd53-49ce-40f8-97f3-5d9819d8b3ba None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:20.960276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:20.960946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:20.961225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:20.961496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:20.962746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:20.965251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:21.008676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1094/2160] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:20 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:21.009941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:21.024326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb662fd4-6595-4c1e-8d1b-638c6e0fbb43 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:21.104630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:21.105364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:21.105676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:21.106154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:21.106864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:21.109158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:21.140418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1067/2161] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:21 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:21.142480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:21.157522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35c9a8-06e2-4a41-8d5a-87bc71c92a69 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:21.165290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:21.166559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:21.166976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:21.167263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:21.168503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:21.170324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:21.188288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1095/2162] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:21.190507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:21.205497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c1c72-68ce-4ce4-a992-b3f5e6e7f014 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:21.213749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370612ff-9135-4724-a307-c1f2ecc40353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:21.215558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370612ff-9135-4724-a307-c1f2ecc40353 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:21.215848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370612ff-9135-4724-a307-c1f2ecc40353 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:21.216135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370612ff-9135-4724-a307-c1f2ecc40353 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:21.217912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370612ff-9135-4724-a307-c1f2ecc40353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:21.219517 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370612ff-9135-4724-a307-c1f2ecc40353 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:21.235438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1068/2163] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:21.240364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:21.252353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685120b6-aca7-450a-ad97-bf883055c123 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:21.259530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:21.260491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:21.260852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:21.261471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] PATH_INFO: `/v3/projects/750564db989249a081b2b5afe0630f6b/users/605fb5d7fa5f4ae0a32c299eead81c8c/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:21.281419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] RBAC: Authorizing `identity:create_grant(project_id=750564db989249a081b2b5afe0630f6b, user_id=605fb5d7fa5f4ae0a32c299eead81c8c, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:21.284316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:21.303859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1096/2164] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:21 2022] PUT /identity/v3/projects/750564db989249a081b2b5afe0630f6b/users/605fb5d7fa5f4ae0a32c299eead81c8c/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:21.309141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc491a6-21ef-4793-80c7-89555bef9da5 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:21.309422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc491a6-21ef-4793-80c7-89555bef9da5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:21.309719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc491a6-21ef-4793-80c7-89555bef9da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:21.318125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:21.334672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-9cc491a6-21ef-4793-80c7-89555bef9da5 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:21.335893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9cc491a6-21ef-4793-80c7-89555bef9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:21.397040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1069/2165] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:21.406776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:21.409054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:21.428331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:21.469126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde31e6f-25e9-4fb7-9993-b5921eaf334c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:21.473583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:21.474180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:21.474454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:21.474720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:21.484660 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:21.486076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:21.495844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1097/2166] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:22.706730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb893-2585-4d07-9b42-b41d0b5b6f78 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:22.707206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb893-2585-4d07-9b42-b41d0b5b6f78 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:22.707308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb893-2585-4d07-9b42-b41d0b5b6f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:22.736990 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d56eb893-2585-4d07-9b42-b41d0b5b6f78 None None] MFA Rules not processed for user `605fb5d7fa5f4ae0a32c299eead81c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:22.738207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d56eb893-2585-4d07-9b42-b41d0b5b6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:22.819877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1070/2167] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:22.830808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:22.832252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:22.900739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91729d-2e9b-4803-a16a-7a0672cc8444 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:22.904614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d204b4-6bcf-445a-806a-951b185a1a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:22.905343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d204b4-6bcf-445a-806a-951b185a1a19 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:22.905693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d204b4-6bcf-445a-806a-951b185a1a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:22.906036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d204b4-6bcf-445a-806a-951b185a1a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:22.916065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d204b4-6bcf-445a-806a-951b185a1a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:22.917568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d204b4-6bcf-445a-806a-951b185a1a19 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:22.928183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1098/2168] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:24.336274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:24.336815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:24.336940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:24.356077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] MFA Rules not processed for user `605fb5d7fa5f4ae0a32c299eead81c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:24.357292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:24.364475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1071/2169] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:30.707653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fe7f-11c8-4a3e-ac7a-f7a8af22539c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:30.708508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fe7f-11c8-4a3e-ac7a-f7a8af22539c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:30.708911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fe7f-11c8-4a3e-ac7a-f7a8af22539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:30.731322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-76a2fe7f-11c8-4a3e-ac7a-f7a8af22539c None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:30.733165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-76a2fe7f-11c8-4a3e-ac7a-f7a8af22539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:30.812373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1099/2170] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:31:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:30.873250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:30.876620 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:31.004878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6197293-d874-4bc1-951f-f5126dcfcfc2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:31.012235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:31.012906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:31.013180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:31.013443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:31.022808 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:31.024624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:31.034321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1072/2171] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:31:31.781233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb586396-220d-4875-9b54-5fa82a12421e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:31.781822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb586396-220d-4875-9b54-5fa82a12421e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:31.781934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb586396-220d-4875-9b54-5fa82a12421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:31.804043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cb586396-220d-4875-9b54-5fa82a12421e None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:31.805299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cb586396-220d-4875-9b54-5fa82a12421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:31.813743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1100/2172] 10.222.0.13 () {58 vars in 967 bytes} [Thu Sep 1 00:31:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:31.827680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:31.840112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665393a0-61c7-459d-8fbd-9c8a76617254 service swift] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:31.846225 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:31.846957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:31.847411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:31.847683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:31.857210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:31.859219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:31.870215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1073/2173] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:31:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 00:31:32.214429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24d68-13a9-4c4a-801f-9bd2acb1ab6f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:32.214722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24d68-13a9-4c4a-801f-9bd2acb1ab6f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:32.215000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24d68-13a9-4c4a-801f-9bd2acb1ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:32.255514 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-85b24d68-13a9-4c4a-801f-9bd2acb1ab6f None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:32.257855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-85b24d68-13a9-4c4a-801f-9bd2acb1ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:32.283189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1101/2174] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:31:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:32.297286 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:32.309482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:32.322788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ddfe7-e571-4d31-83ab-cf461dc19240 service swift] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:32.335812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:32.337019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:32.338245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:32.338737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:32.353325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:32.355157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:32.381735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1074/2175] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:31:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:31:32.951254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:32.952122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:32.952586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:32.993387 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:32.995110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:33.026276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1102/2176] 10.222.0.13 () {58 vars in 967 bytes} [Thu Sep 1 00:31:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:33.044711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:33.059780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3bdaf-4f83-407e-a4cb-7de4654f4f78 service swift] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:33.071795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:33.072446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:33.072728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:33.073001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:33.082851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:33.085295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:33.102731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1075/2177] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:31:34.750140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:34.751591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:34.772102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c569-8b8c-46ff-bfaa-7a69ab8ed0f3 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:34.776641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:34.777274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:34.777576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:34.777849 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] PATH_INFO: `/v3/users/f5a9ce3b6a31420a854c947d4dbca5f7` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:34.779008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a9ce3b6a31420a854c947d4dbca5f7)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:34.780957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:34.823517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:34.831898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a9ce3b6a31420a854c947d4dbca5f7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:34.839701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a9ce3b6a31420a854c947d4dbca5f7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:34.840485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a9ce3b6a31420a854c947d4dbca5f7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:34.849056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a9ce3b6a31420a854c947d4dbca5f7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:34.862378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a9ce3b6a31420a854c947d4dbca5f7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:34.868533 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1103/2178] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:34 2022] DELETE /identity/v3/users/f5a9ce3b6a31420a854c947d4dbca5f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:35.053336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:35.064248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3ef11-e202-4199-90d1-5259564055f4 service swift] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:35.126715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:35.127338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:35.127610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:35.127876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] PATH_INFO: `/v3/projects/17abcde6bbb04ba5b5d02a7f5231da1f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:35.129007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=17abcde6bbb04ba5b5d02a7f5231da1f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:35.130892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:35.178421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17abcde6bbb04ba5b5d02a7f5231da1f', 'request_id': 'req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.184773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17abcde6bbb04ba5b5d02a7f5231da1f', 'request_id': 'req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.190994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17abcde6bbb04ba5b5d02a7f5231da1f', 'request_id': 'req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.206130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] The token cache is being invalidate because project 17abcde6bbb04ba5b5d02a7f5231da1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:35.206415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.207070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.208697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1076/2179] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:35 2022] DELETE /identity/v3/projects/17abcde6bbb04ba5b5d02a7f5231da1f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:35.212735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:35.214177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:35.227958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bcec-ad26-441a-ae0d-80915c13d9d9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:35.286738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:35.287373 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:35.287653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:35.287930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] PATH_INFO: `/v3/users/2a41f1fd1a794788b87393706ef5c200` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:35.289056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a41f1fd1a794788b87393706ef5c200)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:35.290988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:35.341479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a41f1fd1a794788b87393706ef5c200'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.348834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a41f1fd1a794788b87393706ef5c200'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.349489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a41f1fd1a794788b87393706ef5c200'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.357053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a41f1fd1a794788b87393706ef5c200'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.372360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-64999455-c253-4f75-ad90-ad696703b53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a41f1fd1a794788b87393706ef5c200'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.387673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1104/2180] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:35 2022] DELETE /identity/v3/users/2a41f1fd1a794788b87393706ef5c200 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:35.405806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:35.407465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:35.425949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c6182-e2c2-41b0-8dfc-f24b8389f6ce admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:35.488629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:35.489265 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:35.489543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:35.489812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] PATH_INFO: `/v3/users/a26978fb59a24b8898daf217df09f680` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:35.490934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26978fb59a24b8898daf217df09f680)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:35.492892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:35.499625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:35.552730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26978fb59a24b8898daf217df09f680'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.562595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26978fb59a24b8898daf217df09f680'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.574057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26978fb59a24b8898daf217df09f680'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.575078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26978fb59a24b8898daf217df09f680'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.576254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26978fb59a24b8898daf217df09f680'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.604001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1077/2181] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:35 2022] DELETE /identity/v3/users/a26978fb59a24b8898daf217df09f680 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:35.608247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:35.608578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:35.608855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:35.630829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:35.646854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:35.679457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:35.681611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:35.720915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:35.758193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1105/2182] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:35.773259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:35.774993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:35.804917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8f15-aa64-4e72-bbf7-c23f3c26f18f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:35.810002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:35.810654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:35.810964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:35.811255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] PATH_INFO: `/v3/projects/b39093f8fbe940d38c24b9ff0111afab` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:35.812464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39093f8fbe940d38c24b9ff0111afab)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:35.814998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:35.858809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f94c9-35bb-4f4d-b8e8-2d51689cdb8d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:35.874256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39093f8fbe940d38c24b9ff0111afab', 'request_id': 'req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.881939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39093f8fbe940d38c24b9ff0111afab', 'request_id': 'req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.889643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39093f8fbe940d38c24b9ff0111afab', 'request_id': 'req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.907390 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] The token cache is being invalidate because project b39093f8fbe940d38c24b9ff0111afab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:35.908015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.908886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f4c67a82-9aa8-438c-aa85-a06d3779fe2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:35.911811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1078/2183] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:35 2022] DELETE /identity/v3/projects/b39093f8fbe940d38c24b9ff0111afab => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:35.916905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426cc8c-5532-4234-9214-1f966fad5c06 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:35.917714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426cc8c-5532-4234-9214-1f966fad5c06 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:35.918698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426cc8c-5532-4234-9214-1f966fad5c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:35.923924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:35.924600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:35.924909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:35.925194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:35.927114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:35.944339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0426cc8c-5532-4234-9214-1f966fad5c06 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:35.945612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0426cc8c-5532-4234-9214-1f966fad5c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:35.957376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:36.018919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.020413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.023324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1079/2184] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:36.031050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4643b9-817b-4859-bdac-6fb75166deae None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.031335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4643b9-817b-4859-bdac-6fb75166deae None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.031616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4643b9-817b-4859-bdac-6fb75166deae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.037946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1106/2185] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:31:36.056333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ea4643b9-817b-4859-bdac-6fb75166deae None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:36.057589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ea4643b9-817b-4859-bdac-6fb75166deae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:36.066462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1080/2186] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:36.071297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.081864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ff88-4a7e-4540-8587-3fac2d5898d2 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.086678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.087283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.087562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.087846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.088514 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:36.088902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.090526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.103286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1107/2187] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:36.107507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4643b9-817b-4859-bdac-6fb75166deae None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.117376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4643b9-817b-4859-bdac-6fb75166deae None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.122373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.122984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.123264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.123529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.124172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.126134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.165987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1081/2188] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:36 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:36.167172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.177293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ebb0-6fa3-4837-aad4-4420748c9d2c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.212126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:36.241948 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.243678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:36.247856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.248509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.248919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.249335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.249986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.252029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.269546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f5073-e534-4844-b44f-b7e12574cdee admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.276355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.277293 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.277576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.277933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] PATH_INFO: `/v3/projects/9a688be762c44de78af4ed308697dea5` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.279136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a688be762c44de78af4ed308697dea5)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.281205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.281684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1108/2189] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:36 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:36.286547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.297628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f59bd-d267-45ab-82b1-16da5ccadf6e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.303162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.303969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.304411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.304627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.305413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.308422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.322559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1109/2190] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:36.326836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.338129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7970-8021-4b9c-b1e2-87f14fce292b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.348264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a688be762c44de78af4ed308697dea5', 'request_id': 'req-ce4a126c-1bac-4678-a0bf-62597871a0d1'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:36.355753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a688be762c44de78af4ed308697dea5', 'request_id': 'req-ce4a126c-1bac-4678-a0bf-62597871a0d1'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:36.362291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a688be762c44de78af4ed308697dea5', 'request_id': 'req-ce4a126c-1bac-4678-a0bf-62597871a0d1'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:36.377905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] The token cache is being invalidate because project 9a688be762c44de78af4ed308697dea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:36.378603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:36.379371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:36.381324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1082/2191] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:36 2022] DELETE /identity/v3/projects/9a688be762c44de78af4ed308697dea5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:31:36.422105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b3568-1e58-4085-9dc1-84485b96ecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.422835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3568-1e58-4085-9dc1-84485b96ecde admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.423230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3568-1e58-4085-9dc1-84485b96ecde admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.423574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3568-1e58-4085-9dc1-84485b96ecde admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.424310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b3568-1e58-4085-9dc1-84485b96ecde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.426095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b3568-1e58-4085-9dc1-84485b96ecde admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.437720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1110/2192] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:31:36.442502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.444066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:36.463662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a126c-1bac-4678-a0bf-62597871a0d1 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.469021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.469836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.471552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.471552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] PATH_INFO: `/v3/projects/0f58f4da3ab7484f9baa556d24b1a0aa/users/96824fbac5534b3593651a9e0d118562/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.492308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f58f4da3ab7484f9baa556d24b1a0aa, user_id=96824fbac5534b3593651a9e0d118562, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.495267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.511067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1083/2193] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:36 2022] PUT /identity/v3/projects/0f58f4da3ab7484f9baa556d24b1a0aa/users/96824fbac5534b3593651a9e0d118562/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:36.525567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297f223-b0fc-4c5c-be06-64f2b52e1dc3 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.525567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297f223-b0fc-4c5c-be06-64f2b52e1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.525567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297f223-b0fc-4c5c-be06-64f2b52e1dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.556277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b297f223-b0fc-4c5c-be06-64f2b52e1dc3 None None] MFA Rules not processed for user `96824fbac5534b3593651a9e0d118562`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:36.557567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b297f223-b0fc-4c5c-be06-64f2b52e1dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:36.627108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1111/2194] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:36.638623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:36.640516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:36.703940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:36.710429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ccceb-5794-4561-8dea-eda7fc0582d8 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:36.715043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:36.715851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:36.716232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:36.716675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:36.725643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:36.727149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:36.737322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1084/2195] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:46.623491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:46.732788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:47.584134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11941b-694b-4f7c-930c-570813b8d317 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:47.584450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11941b-694b-4f7c-930c-570813b8d317 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:47.584726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11941b-694b-4f7c-930c-570813b8d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:47.609669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-aa11941b-694b-4f7c-930c-570813b8d317 None None] MFA Rules not processed for user `7dd2273d28c14633bd62e590171dac31`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:47.610873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-aa11941b-694b-4f7c-930c-570813b8d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:47.673582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1112/2196] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:48.531320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:48.609560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097baa2-1b25-4a84-a8a6-558c78a1940e service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:48.614740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:48.615361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:48.615639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:48.615908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] PATH_INFO: `/v3/users/96824fbac5534b3593651a9e0d118562` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:48.617031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96824fbac5534b3593651a9e0d118562)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:48.618943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:48.670082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96824fbac5534b3593651a9e0d118562'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:48.683878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96824fbac5534b3593651a9e0d118562'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:48.698170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96824fbac5534b3593651a9e0d118562'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:48.699150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96824fbac5534b3593651a9e0d118562'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:48.700343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96824fbac5534b3593651a9e0d118562'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:48.725043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1085/2197] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:48 2022] DELETE /identity/v3/users/96824fbac5534b3593651a9e0d118562 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:48.730416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764128eb-7cb7-45f8-af97-b65c40d7ba01 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:48.731041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764128eb-7cb7-45f8-af97-b65c40d7ba01 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:48.731480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764128eb-7cb7-45f8-af97-b65c40d7ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:48.752693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-764128eb-7cb7-45f8-af97-b65c40d7ba01 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:48.754879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-764128eb-7cb7-45f8-af97-b65c40d7ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:48.829304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1113/2198] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:48.841925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:48.843860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:48.913631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d684e7-04d0-42ae-ae5c-25704576b577 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:48.918102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:48.918714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:48.919070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:48.919378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:48.929500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:48.931042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:48.942119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1086/2199] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:31:49.138652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87cdea-e021-4474-bdad-f318019ece9a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.138938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87cdea-e021-4474-bdad-f318019ece9a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.139211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87cdea-e021-4474-bdad-f318019ece9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.166795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-da87cdea-e021-4474-bdad-f318019ece9a None None] MFA Rules not processed for user `605fb5d7fa5f4ae0a32c299eead81c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:49.167997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-da87cdea-e021-4474-bdad-f318019ece9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:49.253173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1114/2200] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:49.413386 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:49.415318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:49.428697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05cf1-2499-4bb9-bcf1-a5ac6f2aa497 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:49.433450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:49.434500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.434850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.435410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] PATH_INFO: `/v3/projects/0f58f4da3ab7484f9baa556d24b1a0aa` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.436915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f58f4da3ab7484f9baa556d24b1a0aa)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:49.439483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:49.470287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:49.548717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f58f4da3ab7484f9baa556d24b1a0aa', 'request_id': 'req-7fa0f168-f0e7-4612-9892-90ced11b9932'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:49.557641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f58f4da3ab7484f9baa556d24b1a0aa', 'request_id': 'req-7fa0f168-f0e7-4612-9892-90ced11b9932'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:49.565235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f58f4da3ab7484f9baa556d24b1a0aa', 'request_id': 'req-7fa0f168-f0e7-4612-9892-90ced11b9932'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:49.589174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] The token cache is being invalidate because project 0f58f4da3ab7484f9baa556d24b1a0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:49.589520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:49.590341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7fa0f168-f0e7-4612-9892-90ced11b9932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:49.593042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1087/2201] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:49 2022] DELETE /identity/v3/projects/0f58f4da3ab7484f9baa556d24b1a0aa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:49.598461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e35b0-876f-47c4-bf91-80217861cffb None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.598744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e35b0-876f-47c4-bf91-80217861cffb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.599033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e35b0-876f-47c4-bf91-80217861cffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.623378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2a4e35b0-876f-47c4-bf91-80217861cffb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:49.625223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2a4e35b0-876f-47c4-bf91-80217861cffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:49.682853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:49.704738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1115/2202] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:49.713079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fe54f-94ce-4959-b6b4-ec79247de2d4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.713606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fe54f-94ce-4959-b6b4-ec79247de2d4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.713881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fe54f-94ce-4959-b6b4-ec79247de2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.737982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-127fe54f-94ce-4959-b6b4-ec79247de2d4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:49.739912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-127fe54f-94ce-4959-b6b4-ec79247de2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:49.749617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1088/2203] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:49.754546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e35b0-876f-47c4-bf91-80217861cffb None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:49.764948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e35b0-876f-47c4-bf91-80217861cffb None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:49.769534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:49.770144 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.770424 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.770698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.771350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:49.771652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:49.773284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:49.791445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1116/2204] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:49.793042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fe54f-94ce-4959-b6b4-ec79247de2d4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:49.805634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fe54f-94ce-4959-b6b4-ec79247de2d4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:49.811835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:49.812515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.812887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.813157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.813866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:49.816453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:49.852254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1089/2205] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:49 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:49.855121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:49.864477 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf24478-6a37-45ee-a8b9-0957eede27c3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:49.943621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:49.944161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.944475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.944746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.945372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:49.947273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:49.972442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1117/2206] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:49 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:49.974217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:49.985511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0dc7d-e466-4e53-82c4-6da61b694bd1 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:49.990234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:49.990825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:49.991091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:49.991396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:49.992017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:49.993639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:50.004609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1090/2207] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:50.008630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:50.022513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a632829-7c3a-457a-88ae-e4323bb1dfdc admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:50.027655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b1ba9-a3c8-450f-94fc-bb9a8e2c6c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:50.028586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1ba9-a3c8-450f-94fc-bb9a8e2c6c5e admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:50.028982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1ba9-a3c8-450f-94fc-bb9a8e2c6c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:50.029197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1ba9-a3c8-450f-94fc-bb9a8e2c6c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:50.029885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b1ba9-a3c8-450f-94fc-bb9a8e2c6c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:50.031567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b1ba9-a3c8-450f-94fc-bb9a8e2c6c5e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:50.046966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1118/2208] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:50.048582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:50.062781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86512e-b3c8-47f8-940e-c5c8ee0202cc admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:50.069912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:50.070659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:50.071033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:50.071310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] PATH_INFO: `/v3/projects/19785540c677430583b9ebb2f82a34c3/users/3b363822fa8d4ddb98a1e8c0e8ef2c9f/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:50.087893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19785540c677430583b9ebb2f82a34c3, user_id=3b363822fa8d4ddb98a1e8c0e8ef2c9f, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:50.090845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:50.117337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1091/2209] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:50 2022] PUT /identity/v3/projects/19785540c677430583b9ebb2f82a34c3/users/3b363822fa8d4ddb98a1e8c0e8ef2c9f/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:50.127108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7a61-504e-4629-8400-c384298d342c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:50.127518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7a61-504e-4629-8400-c384298d342c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:50.127798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7a61-504e-4629-8400-c384298d342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:50.163244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1f6c7a61-504e-4629-8400-c384298d342c None None] MFA Rules not processed for user `3b363822fa8d4ddb98a1e8c0e8ef2c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:50.164831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1f6c7a61-504e-4629-8400-c384298d342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:50.255509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1119/2210] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:50.271309 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:50.274624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:50.374891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6cf4b-aed7-4e6c-befe-09b4b8002035 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:50.379548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296ed9-0f20-4387-a911-d312f2dbdb77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:50.380341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296ed9-0f20-4387-a911-d312f2dbdb77 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:50.380653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296ed9-0f20-4387-a911-d312f2dbdb77 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:50.380991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296ed9-0f20-4387-a911-d312f2dbdb77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:50.392539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296ed9-0f20-4387-a911-d312f2dbdb77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:50.394800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296ed9-0f20-4387-a911-d312f2dbdb77 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:50.404596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1092/2211] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:53.141099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7a61-504e-4629-8400-c384298d342c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:53.207493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:53.227123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7a61-504e-4629-8400-c384298d342c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:53.232947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:53.233488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:53.233908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:53.234186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] PATH_INFO: `/v3/users/3b363822fa8d4ddb98a1e8c0e8ef2c9f` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:53.235346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b363822fa8d4ddb98a1e8c0e8ef2c9f)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:53.237879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:53.293301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b363822fa8d4ddb98a1e8c0e8ef2c9f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:53.306605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b363822fa8d4ddb98a1e8c0e8ef2c9f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:53.307443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b363822fa8d4ddb98a1e8c0e8ef2c9f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:53.317973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b363822fa8d4ddb98a1e8c0e8ef2c9f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:53.335729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b363822fa8d4ddb98a1e8c0e8ef2c9f'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:53.343045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1120/2212] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:53 2022] DELETE /identity/v3/users/3b363822fa8d4ddb98a1e8c0e8ef2c9f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:53.348201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:53.348747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:53.348971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:53.385103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:53.387247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:53.442772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:53.478132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1093/2213] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:53.503774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:53.505577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:53.584165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4699b-acb3-45d4-b589-907bbeb66cf1 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:53.587819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b967d-3de8-4f65-890d-e711ec66d190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:53.588365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b967d-3de8-4f65-890d-e711ec66d190 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:53.588671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b967d-3de8-4f65-890d-e711ec66d190 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:53.588938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b967d-3de8-4f65-890d-e711ec66d190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:53.600656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b967d-3de8-4f65-890d-e711ec66d190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:53.601720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b967d-3de8-4f65-890d-e711ec66d190 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:53.613082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1121/2214] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:54.010231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.011943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:54.029742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdd65-50af-498a-9ab2-e6698641ae05 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.035760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.036482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.036728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.036980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] PATH_INFO: `/v3/projects/19785540c677430583b9ebb2f82a34c3` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.038310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19785540c677430583b9ebb2f82a34c3)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.040247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.089277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19785540c677430583b9ebb2f82a34c3', 'request_id': 'req-716fc820-5d66-4774-b460-753b8cfead25'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.095405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19785540c677430583b9ebb2f82a34c3', 'request_id': 'req-716fc820-5d66-4774-b460-753b8cfead25'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.101864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19785540c677430583b9ebb2f82a34c3', 'request_id': 'req-716fc820-5d66-4774-b460-753b8cfead25'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.115538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] The token cache is being invalidate because project 19785540c677430583b9ebb2f82a34c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:54.115823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.116473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-716fc820-5d66-4774-b460-753b8cfead25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.117935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1094/2215] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:54 2022] DELETE /identity/v3/projects/19785540c677430583b9ebb2f82a34c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:54.122960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e49e6d-85e3-45fc-a7e4-2f8d0106eaa8 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.123194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e49e6d-85e3-45fc-a7e4-2f8d0106eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.123516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e49e6d-85e3-45fc-a7e4-2f8d0106eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.143368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d7e49e6d-85e3-45fc-a7e4-2f8d0106eaa8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:54.144605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d7e49e6d-85e3-45fc-a7e4-2f8d0106eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:54.217340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1122/2216] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:54.226718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647484-3cbf-4891-af78-74070eec4249 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.226967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647484-3cbf-4891-af78-74070eec4249 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.227275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647484-3cbf-4891-af78-74070eec4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.251625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-55647484-3cbf-4891-af78-74070eec4249 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:54.253431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-55647484-3cbf-4891-af78-74070eec4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:54.261426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1095/2217] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:54.265657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e49e6d-85e3-45fc-a7e4-2f8d0106eaa8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.275797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e49e6d-85e3-45fc-a7e4-2f8d0106eaa8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.280569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.281173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.281454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.281724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.282405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:54.282708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.285186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.287730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:54.298848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1123/2218] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:54.303143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647484-3cbf-4891-af78-74070eec4249 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.320450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647484-3cbf-4891-af78-74070eec4249 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.328289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.329416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.330290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.331502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.333340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.337126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.367140 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1096/2219] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:54 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:54.371880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.382554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe0f23-60b3-4a6b-806d-c79a19addaf6 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.438928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.440213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.440637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.441008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.441729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.444162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.466999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1124/2220] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:54 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:31:54.471105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.481688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cdf3a-df60-4648-88d3-e9485e23185b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.486307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.486900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.487178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.487450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.488086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.489708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.500161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1097/2221] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:31:54.505652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.517546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf3271-81c8-4e5f-aa45-06aea19ce78b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.523077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a716a-eb43-465a-ba42-4c909ae051c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.523680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a716a-eb43-465a-ba42-4c909ae051c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.523985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a716a-eb43-465a-ba42-4c909ae051c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.524259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a716a-eb43-465a-ba42-4c909ae051c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.524945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a716a-eb43-465a-ba42-4c909ae051c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.526580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a716a-eb43-465a-ba42-4c909ae051c5 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.537306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1125/2222] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:54.541431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.551463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8683-e299-495c-a06f-488a70d1a819 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.556097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.556773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.557049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.557339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] PATH_INFO: `/v3/projects/d29579cbd9ea49b494d96d63d36149b3/users/6f1ce5ef8759488d8f5be0436d242a3c/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.572352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29579cbd9ea49b494d96d63d36149b3, user_id=6f1ce5ef8759488d8f5be0436d242a3c, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.575066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.588754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1098/2223] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:54 2022] PUT /identity/v3/projects/d29579cbd9ea49b494d96d63d36149b3/users/6f1ce5ef8759488d8f5be0436d242a3c/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:54.600041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff16eb-2bf4-4477-b9e8-df86c1c18f69 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.600330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff16eb-2bf4-4477-b9e8-df86c1c18f69 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.600638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff16eb-2bf4-4477-b9e8-df86c1c18f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.629598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b6ff16eb-2bf4-4477-b9e8-df86c1c18f69 None None] MFA Rules not processed for user `6f1ce5ef8759488d8f5be0436d242a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:54.630803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b6ff16eb-2bf4-4477-b9e8-df86c1c18f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:54.698635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1126/2224] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:54.710554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.712305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:54.776543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdea63-0427-46a4-82e8-59602c591628 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.779583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3097d5a-e874-4c15-9e20-3bed15a70d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.780194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3097d5a-e874-4c15-9e20-3bed15a70d57 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.780514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3097d5a-e874-4c15-9e20-3bed15a70d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.780928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3097d5a-e874-4c15-9e20-3bed15a70d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.790392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3097d5a-e874-4c15-9e20-3bed15a70d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.791875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3097d5a-e874-4c15-9e20-3bed15a70d57 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.801221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1099/2225] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:54.828021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff16eb-2bf4-4477-b9e8-df86c1c18f69 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:54.897991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff16eb-2bf4-4477-b9e8-df86c1c18f69 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:54.902835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:54.903401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:54.903840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:54.904123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] PATH_INFO: `/v3/users/6f1ce5ef8759488d8f5be0436d242a3c` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:54.905366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1ce5ef8759488d8f5be0436d242a3c)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:54.907336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:54.913246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:54.964093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1ce5ef8759488d8f5be0436d242a3c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.971899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1ce5ef8759488d8f5be0436d242a3c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.972653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1ce5ef8759488d8f5be0436d242a3c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.981531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1ce5ef8759488d8f5be0436d242a3c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:54.995351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1ce5ef8759488d8f5be0436d242a3c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:55.001582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1127/2226] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:31:54 2022] DELETE /identity/v3/users/6f1ce5ef8759488d8f5be0436d242a3c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:55.006407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:55.006771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:55.007051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:55.022070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:55.029869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:55.031742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:55.101269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1100/2227] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:55.111903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:55.113347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:55.189552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c67218-da44-4016-bdd7-1ef7a68712c0 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:55.197383 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47742e-6db5-4285-aadf-b81c1ec8ca79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:55.198564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47742e-6db5-4285-aadf-b81c1ec8ca79 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:55.199075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47742e-6db5-4285-aadf-b81c1ec8ca79 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:55.199516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47742e-6db5-4285-aadf-b81c1ec8ca79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:55.212400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47742e-6db5-4285-aadf-b81c1ec8ca79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:55.213886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47742e-6db5-4285-aadf-b81c1ec8ca79 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:55.223798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1128/2228] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:31:55.659504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:55.661333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:55.674891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301722a-59b9-4f3e-acad-129d56ce314c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:55.679789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:55.680364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:55.680671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:55.680942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] PATH_INFO: `/v3/projects/d29579cbd9ea49b494d96d63d36149b3` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:55.682082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29579cbd9ea49b494d96d63d36149b3)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:55.684009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:55.733835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29579cbd9ea49b494d96d63d36149b3', 'request_id': 'req-ed23c128-b03c-4d27-9150-980fa2f611cf'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:55.740697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29579cbd9ea49b494d96d63d36149b3', 'request_id': 'req-ed23c128-b03c-4d27-9150-980fa2f611cf'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:55.746693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29579cbd9ea49b494d96d63d36149b3', 'request_id': 'req-ed23c128-b03c-4d27-9150-980fa2f611cf'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:55.760682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] The token cache is being invalidate because project d29579cbd9ea49b494d96d63d36149b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:31:55.760975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:55.761630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ed23c128-b03c-4d27-9150-980fa2f611cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:31:55.763168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1101/2229] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:31:55 2022] DELETE /identity/v3/projects/d29579cbd9ea49b494d96d63d36149b3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:55.769048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d14b8c-4d9a-4770-90f3-00286dcaaabb None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:55.769407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d14b8c-4d9a-4770-90f3-00286dcaaabb None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:55.769777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d14b8c-4d9a-4770-90f3-00286dcaaabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:55.789726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-53d14b8c-4d9a-4770-90f3-00286dcaaabb None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:55.790936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-53d14b8c-4d9a-4770-90f3-00286dcaaabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:55.851487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1129/2230] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:55.859793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068538cb-9091-45b4-bf20-f0dd59d2d29e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:55.860095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068538cb-9091-45b4-bf20-f0dd59d2d29e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:55.860405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068538cb-9091-45b4-bf20-f0dd59d2d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:55.880516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-068538cb-9091-45b4-bf20-f0dd59d2d29e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:55.881701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-068538cb-9091-45b4-bf20-f0dd59d2d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:55.889487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1102/2231] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:55.894293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d14b8c-4d9a-4770-90f3-00286dcaaabb None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:55.904457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d14b8c-4d9a-4770-90f3-00286dcaaabb None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:55.909851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:55.910491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:55.910733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:55.910996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:55.912053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:31:55.912053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:55.914430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:55.929119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1130/2232] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:31:55.933527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068538cb-9091-45b4-bf20-f0dd59d2d29e None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:55.946331 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068538cb-9091-45b4-bf20-f0dd59d2d29e None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:55.953007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:55.953669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:55.953945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:55.954212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:55.954853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:55.957420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:55.993114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1103/2233] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:31:55 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:55.997256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:56.008837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0749a-86b5-42d7-af3e-63514f95c044 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:56.023350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:56.090662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:56.092170 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:56.093242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:56.093730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:56.094911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:56.099164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:56.124005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1131/2234] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:31:55 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:31:56.128816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:56.139209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2bb1a-2e6d-4b66-b4f7-c529c72b0e60 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:56.144768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:56.145554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:56.146021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:56.146347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:56.146999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:56.148983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:56.160289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1104/2235] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:56.164590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:56.175447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359bc72-077e-4410-804e-14dbf88d89b4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:56.198567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad1e75-a7ff-4d95-9c2c-843f93204962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:56.199414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1e75-a7ff-4d95-9c2c-843f93204962 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:56.199728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1e75-a7ff-4d95-9c2c-843f93204962 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:56.200027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1e75-a7ff-4d95-9c2c-843f93204962 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:56.201027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad1e75-a7ff-4d95-9c2c-843f93204962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:56.203150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad1e75-a7ff-4d95-9c2c-843f93204962 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:56.229668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:56.230551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1132/2236] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:31:56.240850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff01c-8fe7-4e19-9173-e63458b6ee9f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:56.246310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:56.246974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:56.247258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:56.247536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] PATH_INFO: `/v3/projects/4fa1ea00378d4512b6f2520e8b292903/users/fd96430c5667411e8d8c7825d09e95cf/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:56.265815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa1ea00378d4512b6f2520e8b292903, user_id=fd96430c5667411e8d8c7825d09e95cf, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:56.270133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:56.288630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1105/2237] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:31:56 2022] PUT /identity/v3/projects/4fa1ea00378d4512b6f2520e8b292903/users/fd96430c5667411e8d8c7825d09e95cf/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:31:56.293878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374730-05f0-4927-b846-de253a9dbff8 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:56.294163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374730-05f0-4927-b846-de253a9dbff8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:56.295114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374730-05f0-4927-b846-de253a9dbff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:56.315022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-21374730-05f0-4927-b846-de253a9dbff8 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:56.316269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-21374730-05f0-4927-b846-de253a9dbff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:56.438264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1133/2238] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:31:56.478825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:56.480742 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:56.527861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:56.581920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6b80f-b0b1-448c-844f-9e130c363a07 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:56.587431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:56.588153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:56.588536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:56.588880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:56.604917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:56.606356 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:56.620263 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1106/2239] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:31:57.195060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882c64-fe3a-4368-ad95-c074fe140cfa None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:57.195484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882c64-fe3a-4368-ad95-c074fe140cfa None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:57.196012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882c64-fe3a-4368-ad95-c074fe140cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:57.217302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-74882c64-fe3a-4368-ad95-c074fe140cfa None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:31:57.218396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-74882c64-fe3a-4368-ad95-c074fe140cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:57.227334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1134/2240] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:31:57.243717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:31:57.245376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:31:57.346698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f908cff-91e2-4f8f-9208-a06e53d88db4 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:31:57.357004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:31:57.357636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:31:57.357903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:31:57.358174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:31:57.367869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:31:57.369541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:31:57.380441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1107/2241] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:00.593393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d175f0f-c455-4944-b449-880a6ce5c072 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:00.593970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d175f0f-c455-4944-b449-880a6ce5c072 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:00.594346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d175f0f-c455-4944-b449-880a6ce5c072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:00.617292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7d175f0f-c455-4944-b449-880a6ce5c072 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:00.619943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7d175f0f-c455-4944-b449-880a6ce5c072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:00.693929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1135/2242] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:32:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:00.709775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:00.712295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:00.820670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9889b7e-2736-4202-ad23-9df5030c4658 service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:00.827294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:00.828081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:00.828373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:00.828703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:00.840566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:00.843016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:00.855296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1108/2243] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:32:01.491845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fb775-c599-4783-baa4-867a1e1ff969 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:01.492271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fb775-c599-4783-baa4-867a1e1ff969 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:01.492664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fb775-c599-4783-baa4-867a1e1ff969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:01.546087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-744fb775-c599-4783-baa4-867a1e1ff969 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:01.547976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-744fb775-c599-4783-baa4-867a1e1ff969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:01.569777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1136/2244] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:01.914470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:01.959441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086fc33-bd5f-4100-ac5b-17e3d7026090 service swift] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:01.978196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:01.979183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:01.979683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:01.980224 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:02.035746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:02.035746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:02.057652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1109/2245] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:02.762778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa743-6470-4d9f-8bfc-9a6e8973778c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:02.764416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa743-6470-4d9f-8bfc-9a6e8973778c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:02.764935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa743-6470-4d9f-8bfc-9a6e8973778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:02.798939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4c8fa743-6470-4d9f-8bfc-9a6e8973778c None None] MFA Rules not processed for user `fd96430c5667411e8d8c7825d09e95cf`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:02.800452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4c8fa743-6470-4d9f-8bfc-9a6e8973778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:02.821344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:02.922082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1137/2246] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:32:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:02.928156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:02.945839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761a79c-d20d-4e51-994d-27ecf0d6582e service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:02.952101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:02.953104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:02.953575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:02.954056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:02.956033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:02.958304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:02.997792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1110/2247] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:32:02 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:32:03.001217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fa743-6470-4d9f-8bfc-9a6e8973778c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:03.015370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fa743-6470-4d9f-8bfc-9a6e8973778c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:03.112669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:03.113709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:03.113997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:03.114405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:03.115064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:03.117766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:03.177569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1138/2248] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:32:03 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:32:03.178324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:03.193694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e86b3-e712-4c18-b6b0-99dc7f906a87 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:03.207979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:03.208887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:03.209810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:03.210242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:03.211087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:03.215178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:03.217888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:03.241329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:03.251236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1111/2249] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:32:03.253937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915325f4-0434-4835-b01a-71ffeaf24059 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:03.260871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:03.261546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:03.261826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:03.262102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] PATH_INFO: `/v3/projects/b27eab5cb3814e05b770f03bc56d1f5c/users/fb96e703c2b54653845657f672c3bdea/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:03.286448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27eab5cb3814e05b770f03bc56d1f5c, user_id=fb96e703c2b54653845657f672c3bdea, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:03.301460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:03.325742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1139/2250] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:32:03 2022] PUT /identity/v3/projects/b27eab5cb3814e05b770f03bc56d1f5c/users/fb96e703c2b54653845657f672c3bdea/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:32:03.331968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:03.355576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf84d3-f23f-48e8-ac76-6434a12fc308 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:03.466439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fed6a-8da0-4888-b2bb-287ae8ffc230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:03.467049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fed6a-8da0-4888-b2bb-287ae8ffc230 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:03.467323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fed6a-8da0-4888-b2bb-287ae8ffc230 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:03.467590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fed6a-8da0-4888-b2bb-287ae8ffc230 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:03.469369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fed6a-8da0-4888-b2bb-287ae8ffc230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:03.470130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fed6a-8da0-4888-b2bb-287ae8ffc230 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:03.485584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1112/2251] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:32:03.487091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:03.499861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0ee7-0375-405d-a003-7f5df55f2373 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:03.509153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:03.510222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:03.510713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:03.511224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] PATH_INFO: `/v3/projects/b27eab5cb3814e05b770f03bc56d1f5c/users/fb96e703c2b54653845657f672c3bdea/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:03.513366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27eab5cb3814e05b770f03bc56d1f5c, user_id=fb96e703c2b54653845657f672c3bdea, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:03.516154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:03.540404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1140/2252] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:32:03 2022] PUT /identity/v3/projects/b27eab5cb3814e05b770f03bc56d1f5c/users/fb96e703c2b54653845657f672c3bdea/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:32:06.221929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd93c-962a-4cd5-9dd4-ed3f5eefba08 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:06.222867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd93c-962a-4cd5-9dd4-ed3f5eefba08 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:06.223316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd93c-962a-4cd5-9dd4-ed3f5eefba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:06.285982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-dd6dd93c-962a-4cd5-9dd4-ed3f5eefba08 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:06.288023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-dd6dd93c-962a-4cd5-9dd4-ed3f5eefba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:06.536788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1113/2253] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:06.884185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:07.073349 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:07.086089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d505b37-e9b0-4737-9b66-8e40732ac7a3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:07.115127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:07.116625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:07.117356 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:07.117809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:07.137789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:07.140858 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:07.176750 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1141/2254] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:12.625357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f949a52-1660-4dc2-b3bb-ed8ce3e86c8e None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:12.626485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f949a52-1660-4dc2-b3bb-ed8ce3e86c8e None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:12.627441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f949a52-1660-4dc2-b3bb-ed8ce3e86c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:12.669338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1f949a52-1660-4dc2-b3bb-ed8ce3e86c8e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:12.671295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1f949a52-1660-4dc2-b3bb-ed8ce3e86c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:12.705405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1114/2255] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:12.727459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:12.729346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:12.755557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c076df-3a49-4c32-9089-118f45ce4a24 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:12.785228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:12.785875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:12.786162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:12.786771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:12.802692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:12.804450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:12.902616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1142/2256] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:14.409087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813b742-c942-43bb-93d3-c0d9971ad03a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:14.409695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813b742-c942-43bb-93d3-c0d9971ad03a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:14.409695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813b742-c942-43bb-93d3-c0d9971ad03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:14.445689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5813b742-c942-43bb-93d3-c0d9971ad03a None None] MFA Rules not processed for user `fb96e703c2b54653845657f672c3bdea`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:14.448373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5813b742-c942-43bb-93d3-c0d9971ad03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:14.599849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1115/2257] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:32:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:14.616176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:14.618343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:14.731506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ff3e-7c0e-44ae-9139-105b52edef10 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:14.736043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:14.736700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:14.737171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:14.737606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:14.814786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:14.816702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:14.846002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1143/2258] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:15.085556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4a362-a3d0-4df1-8fa7-0d39c0cd7d40 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:15.085855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4a362-a3d0-4df1-8fa7-0d39c0cd7d40 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:15.086123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4a362-a3d0-4df1-8fa7-0d39c0cd7d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:15.116861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d3b4a362-a3d0-4df1-8fa7-0d39c0cd7d40 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:15.119180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d3b4a362-a3d0-4df1-8fa7-0d39c0cd7d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:15.130464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:15.227311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1116/2259] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:32:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:15.254651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:15.365810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75630be0-993b-41c5-b721-4690611c7255 service glance] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:15.371605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:15.372288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:15.372599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:15.372875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:15.392344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:15.394193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:15.404141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1144/2260] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:32:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:32:17.017819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0ee55-c918-4a45-8efb-c1b791561bfe None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:17.018348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0ee55-c918-4a45-8efb-c1b791561bfe None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:17.018348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0ee55-c918-4a45-8efb-c1b791561bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:17.062260 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b3e0ee55-c918-4a45-8efb-c1b791561bfe None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:17.063942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b3e0ee55-c918-4a45-8efb-c1b791561bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:17.082307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1117/2261] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:17.107659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:17.158899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecc01f-5e0d-4b1a-b6d8-5731a5a0e2bb service swift] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:17.174180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:17.181183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:17.183497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:17.183889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:17.207497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:17.209372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:17.244267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1145/2262] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:21.294003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cdca-8ccb-4680-bd1f-2a45d0ff4d3a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:21.294568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cdca-8ccb-4680-bd1f-2a45d0ff4d3a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:21.294890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cdca-8ccb-4680-bd1f-2a45d0ff4d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:21.333984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c5b3cdca-8ccb-4680-bd1f-2a45d0ff4d3a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:21.336306 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c5b3cdca-8ccb-4680-bd1f-2a45d0ff4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:21.352793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1118/2263] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:21.382097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:21.397446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cea61-dceb-4a5d-a85a-5a60e0ad07c9 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:21.403041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:21.403694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:21.403965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:21.404444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:21.411778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:21.416729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:21.418595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:21.433585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1146/2264] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:22.911133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b6b1-c5c5-4901-9e9d-214773de21d4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:22.911718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b6b1-c5c5-4901-9e9d-214773de21d4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:22.911823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b6b1-c5c5-4901-9e9d-214773de21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:22.935511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ee93b6b1-c5c5-4901-9e9d-214773de21d4 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:22.938932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ee93b6b1-c5c5-4901-9e9d-214773de21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:22.948212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1119/2265] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:32:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:22.961708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:22.995763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a85c4-b95a-4fb1-8f3a-010c54e10596 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:23.002317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d964c6-f560-4505-9b66-732d8e2881f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:23.010651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d964c6-f560-4505-9b66-732d8e2881f7 service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:23.011794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d964c6-f560-4505-9b66-732d8e2881f7 service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:23.012277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d964c6-f560-4505-9b66-732d8e2881f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:23.029769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d964c6-f560-4505-9b66-732d8e2881f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:23.043225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d964c6-f560-4505-9b66-732d8e2881f7 service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:23.065496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1147/2266] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:32:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 00:32:25.659139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72279c-f4ff-4f5f-b609-1d758daf1fd5 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:25.660255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72279c-f4ff-4f5f-b609-1d758daf1fd5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:25.660877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72279c-f4ff-4f5f-b609-1d758daf1fd5 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:25.662625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1120/2267] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:32:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:32:25.675093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5426a0b-8eb9-4b99-8ade-b5630c2da11b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:25.675820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5426a0b-8eb9-4b99-8ade-b5630c2da11b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:25.675820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5426a0b-8eb9-4b99-8ade-b5630c2da11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:25.714812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d5426a0b-8eb9-4b99-8ade-b5630c2da11b None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:25.717279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d5426a0b-8eb9-4b99-8ade-b5630c2da11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:25.749453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1148/2268] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:32:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:27.585985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72279c-f4ff-4f5f-b609-1d758daf1fd5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:27.605925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72279c-f4ff-4f5f-b609-1d758daf1fd5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:27.611672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a5e93-b14e-4023-bc26-5229690baeca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:27.612558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5e93-b14e-4023-bc26-5229690baeca service glance] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:27.612934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5e93-b14e-4023-bc26-5229690baeca service glance] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:27.613342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5e93-b14e-4023-bc26-5229690baeca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:27.632112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a5e93-b14e-4023-bc26-5229690baeca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:27.633988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a5e93-b14e-4023-bc26-5229690baeca service glance] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:27.651051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1121/2269] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:27.691150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4f507-5f9d-4eb4-89f7-aa2d9b39ae26 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:27.691706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4f507-5f9d-4eb4-89f7-aa2d9b39ae26 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:27.691841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4f507-5f9d-4eb4-89f7-aa2d9b39ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:27.748594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6ce4f507-5f9d-4eb4-89f7-aa2d9b39ae26 None None] MFA Rules not processed for user `fd96430c5667411e8d8c7825d09e95cf`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:27.754627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6ce4f507-5f9d-4eb4-89f7-aa2d9b39ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:27.776291 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1149/2270] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:32:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:27.802631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10a48-0ee6-4f7e-96a4-76b291f6da6b None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:27.803240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10a48-0ee6-4f7e-96a4-76b291f6da6b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:27.803662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10a48-0ee6-4f7e-96a4-76b291f6da6b None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:27.805661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1122/2271] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:32:27.811251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37915e27-f73a-4a40-9418-a486f6645e48 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:27.811749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37915e27-f73a-4a40-9418-a486f6645e48 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:27.812120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37915e27-f73a-4a40-9418-a486f6645e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:27.833905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-37915e27-f73a-4a40-9418-a486f6645e48 None None] MFA Rules not processed for user `baa7f3487b674e75afe5fca74db44807`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:27.835549 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-37915e27-f73a-4a40-9418-a486f6645e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:27.910231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1150/2272] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:32:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:27.910939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff10a48-0ee6-4f7e-96a4-76b291f6da6b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:27.923404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff10a48-0ee6-4f7e-96a4-76b291f6da6b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:27.927535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424be2c-5d82-402c-aa5c-8e1581bcea75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:27.928437 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424be2c-5d82-402c-aa5c-8e1581bcea75 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:27.928944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424be2c-5d82-402c-aa5c-8e1581bcea75 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:27.929436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424be2c-5d82-402c-aa5c-8e1581bcea75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:27.939959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424be2c-5d82-402c-aa5c-8e1581bcea75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:27.941798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424be2c-5d82-402c-aa5c-8e1581bcea75 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:27.960988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1123/2273] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:28.089755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1631c-4943-4947-b4e7-4d97512669b3 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:28.090509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1631c-4943-4947-b4e7-4d97512669b3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:28.090914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1631c-4943-4947-b4e7-4d97512669b3 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:28.092897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1151/2274] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:32:28.101396 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d118f5-bab7-4b59-8a3b-7ae65b004d37 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:28.101671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d118f5-bab7-4b59-8a3b-7ae65b004d37 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:28.102639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d118f5-bab7-4b59-8a3b-7ae65b004d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:28.147284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-16d118f5-bab7-4b59-8a3b-7ae65b004d37 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:28.150303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-16d118f5-bab7-4b59-8a3b-7ae65b004d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:28.174168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1124/2275] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:32:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:32:28.186755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1631c-4943-4947-b4e7-4d97512669b3 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:28.288936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1631c-4943-4947-b4e7-4d97512669b3 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:28.310882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:28.316087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:28.318725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:28.320330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:28.350971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:28.355014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:28.389967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1152/2276] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:37.024998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065a2c-af9f-4b0c-a0fc-412d487e28e8 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:37.025564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065a2c-af9f-4b0c-a0fc-412d487e28e8 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:37.025564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065a2c-af9f-4b0c-a0fc-412d487e28e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:37.067476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1b065a2c-af9f-4b0c-a0fc-412d487e28e8 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:37.071811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1b065a2c-af9f-4b0c-a0fc-412d487e28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:37.089048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1125/2277] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:37.096824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:37.122815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d4f7a-c1e3-47c7-9d19-18935b0f92d0 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:37.134755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91872f5-7f45-458b-a4bb-312934a7ff13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:37.135228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91872f5-7f45-458b-a4bb-312934a7ff13 service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:37.135507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91872f5-7f45-458b-a4bb-312934a7ff13 service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:37.135784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91872f5-7f45-458b-a4bb-312934a7ff13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:37.164825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91872f5-7f45-458b-a4bb-312934a7ff13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:37.178256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91872f5-7f45-458b-a4bb-312934a7ff13 service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:37.205339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1153/2278] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:32:40.370262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0b09e-27f3-453d-85e5-e04bc917cb29 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:40.371373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0b09e-27f3-453d-85e5-e04bc917cb29 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:40.371881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0b09e-27f3-453d-85e5-e04bc917cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:40.407122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-44d0b09e-27f3-453d-85e5-e04bc917cb29 None None] MFA Rules not processed for user `bca116e3c8de4cf2aac77028c7e40a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:40.419695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-44d0b09e-27f3-453d-85e5-e04bc917cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:40.617174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1126/2279] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:32:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:43.925243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd9c7-fada-4ffd-9650-4589d19e299a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:43.925897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd9c7-fada-4ffd-9650-4589d19e299a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:43.925897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd9c7-fada-4ffd-9650-4589d19e299a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:43.949116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-8c8cd9c7-fada-4ffd-9650-4589d19e299a None None] MFA Rules not processed for user `b714e26a0db64849b0d42f7c8e3db39a`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:43.950363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8c8cd9c7-fada-4ffd-9650-4589d19e299a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:44.064069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1154/2280] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:32:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:44.194009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329206-c3cf-49f4-9274-05fc7f92a5b4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:44.194896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329206-c3cf-49f4-9274-05fc7f92a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:44.195336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329206-c3cf-49f4-9274-05fc7f92a5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:44.222976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f9329206-c3cf-49f4-9274-05fc7f92a5b4 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:44.227442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f9329206-c3cf-49f4-9274-05fc7f92a5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:44.241915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1127/2281] 10.222.0.13 () {58 vars in 967 bytes} [Thu Sep 1 00:32:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:44.261065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cd9c7-fada-4ffd-9650-4589d19e299a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:44.280498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cd9c7-fada-4ffd-9650-4589d19e299a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:44.293166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749e61-ef9c-4bba-b778-0ad3651eef8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:44.293914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749e61-ef9c-4bba-b778-0ad3651eef8f service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:44.294280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749e61-ef9c-4bba-b778-0ad3651eef8f service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:44.294652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749e61-ef9c-4bba-b778-0ad3651eef8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:44.314344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749e61-ef9c-4bba-b778-0ad3651eef8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:44.316121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749e61-ef9c-4bba-b778-0ad3651eef8f service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:44.336746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1155/2282] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:32:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 00:32:46.921677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d67736-1d16-4b37-bdc9-1da57590a313 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:46.923237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d67736-1d16-4b37-bdc9-1da57590a313 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:46.924055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d67736-1d16-4b37-bdc9-1da57590a313 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:46.926007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1128/2283] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:32:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:32:47.193338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89049a7-c4b5-4ecb-ac53-316e575bc780 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:47.194233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89049a7-c4b5-4ecb-ac53-316e575bc780 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:47.194670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89049a7-c4b5-4ecb-ac53-316e575bc780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:47.215802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a89049a7-c4b5-4ecb-ac53-316e575bc780 None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:47.217600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a89049a7-c4b5-4ecb-ac53-316e575bc780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:47.271454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:47.302477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d67736-1d16-4b37-bdc9-1da57590a313 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:47.304658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e0d67736-1d16-4b37-bdc9-1da57590a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:47.316922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1156/2284] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:32:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:47.322547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=75 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:47.333721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef016-7019-42ec-8f16-4eb259fa6404 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:47.334138 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef016-7019-42ec-8f16-4eb259fa6404 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:47.334488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef016-7019-42ec-8f16-4eb259fa6404 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:47.336580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1157/2285] 10.222.0.13 () {54 vars in 961 bytes} [Thu Sep 1 00:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:32:47.346249 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4ce4-ebae-4e50-9c7a-688b1aa6787c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:47.346631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4ce4-ebae-4e50-9c7a-688b1aa6787c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:47.348622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4ce4-ebae-4e50-9c7a-688b1aa6787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:47.349447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d67736-1d16-4b37-bdc9-1da57590a313 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:47.355007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:47.356544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:47.357048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:47.357693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] PATH_INFO: `/v3/users/605fb5d7fa5f4ae0a32c299eead81c8c` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:47.359385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=605fb5d7fa5f4ae0a32c299eead81c8c)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:47.361627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:47.380075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-913f4ce4-ebae-4e50-9c7a-688b1aa6787c None None] MFA Rules not processed for user `db5c6d78083342ab923e2258b763dc36`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:47.381474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-913f4ce4-ebae-4e50-9c7a-688b1aa6787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:47.392510 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1158/2286] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Sep 1 00:32:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:47.404143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4ce4-ebae-4e50-9c7a-688b1aa6787c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:47.418117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4ce4-ebae-4e50-9c7a-688b1aa6787c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:47.436503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:47.437126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:47.437790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:47.437790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:47.459205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605fb5d7fa5f4ae0a32c299eead81c8c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.460498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:47.462137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:47.476970 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605fb5d7fa5f4ae0a32c299eead81c8c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.486806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1159/2287] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:32:47.507056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605fb5d7fa5f4ae0a32c299eead81c8c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.509461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605fb5d7fa5f4ae0a32c299eead81c8c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.510457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cedc9848-4931-42d9-aa9f-6091217587ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605fb5d7fa5f4ae0a32c299eead81c8c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.548110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1129/2288] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:32:47 2022] DELETE /identity/v3/users/605fb5d7fa5f4ae0a32c299eead81c8c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:32:47.727527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:47.751620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf11bd2-576e-4a74-87dc-4445badbe846 service placement] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:47.814848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:47.815472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:47.815749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:47.816021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] PATH_INFO: `/v3/projects/750564db989249a081b2b5afe0630f6b` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:47.817171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750564db989249a081b2b5afe0630f6b)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:47.819082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:47.864661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750564db989249a081b2b5afe0630f6b', 'request_id': 'req-5d3fbffb-91ca-44da-a525-213bd44f7e41'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.870823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750564db989249a081b2b5afe0630f6b', 'request_id': 'req-5d3fbffb-91ca-44da-a525-213bd44f7e41'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.877819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750564db989249a081b2b5afe0630f6b', 'request_id': 'req-5d3fbffb-91ca-44da-a525-213bd44f7e41'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.888339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] The token cache is being invalidate because project 750564db989249a081b2b5afe0630f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:32:47.888654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.889278 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:32:47.891290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1160/2289] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:32:47 2022] DELETE /identity/v3/projects/750564db989249a081b2b5afe0630f6b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:32:48.301447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e445-449c-4262-9f04-dab38a119620 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:48.301957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e445-449c-4262-9f04-dab38a119620 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:48.302048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e445-449c-4262-9f04-dab38a119620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:48.321504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c766e445-449c-4262-9f04-dab38a119620 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:32:48.322690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c766e445-449c-4262-9f04-dab38a119620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:48.377167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1130/2290] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:32:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:32:48.389020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:48.391111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:48.442770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:48.462561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fbffb-91ca-44da-a525-213bd44f7e41 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:48.467683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:48.468316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:48.468624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:48.468891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:48.477435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:48.479004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:48.487514 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1161/2291] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:32:58.370077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:58.483914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=9 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:59.076114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e445-449c-4262-9f04-dab38a119620 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:59.077309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:32:59.078440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c766e445-449c-4262-9f04-dab38a119620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:59.079795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:59.170006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e445-449c-4262-9f04-dab38a119620 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:59.177182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd52d-e6b1-474f-82b7-72b80c3b0365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:59.177819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd52d-e6b1-474f-82b7-72b80c3b0365 service placement] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:59.178221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd52d-e6b1-474f-82b7-72b80c3b0365 service placement] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:59.178861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd52d-e6b1-474f-82b7-72b80c3b0365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:59.180160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-cf5cd52d-e6b1-474f-82b7-72b80c3b0365 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:32:59.190909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03491-3d40-46ff-9b44-568bea3f4ad3 service swift] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:32:59.193136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cd52d-e6b1-474f-82b7-72b80c3b0365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:59.194748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cd52d-e6b1-474f-82b7-72b80c3b0365 service placement] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:59.195890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:32:59.196719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:32:59.197163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:32:59.197592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:32:59.205337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1131/2292] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:32:59.207075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:32:59.209427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:32:59.222942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1162/2293] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:32:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:33:07.527870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:07.528341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:07.528341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:07.564626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:33:07.565873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:07.584894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1132/2294] 10.222.0.13 () {58 vars in 967 bytes} [Thu Sep 1 00:33:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:33:07.599168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:33:07.619757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9f77-be17-491b-a6ea-c4ea999eb14d service placement] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:33:07.625107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255d7f1-40a3-466a-8a71-16698b8b2996 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:33:07.625725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d7f1-40a3-466a-8a71-16698b8b2996 service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:07.625999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d7f1-40a3-466a-8a71-16698b8b2996 service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:07.626263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d7f1-40a3-466a-8a71-16698b8b2996 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:07.635334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255d7f1-40a3-466a-8a71-16698b8b2996 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:33:07.637151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255d7f1-40a3-466a-8a71-16698b8b2996 service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:33:07.646921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1163/2295] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:33:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:33:09.572526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:33:09.573639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:09.629956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068f9a6-c4ce-4d07-bd32-18a5d006eeac None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:33:09.633447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:33:09.634047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:09.634325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:09.634590 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:09.636332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:09.699769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:33:09.701712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:33:09.711837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1133/2296] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:33:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:33:17.643761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=38 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:19.707027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=85 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:21.935486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2c4d-0d41-46d5-b483-9dde0c409f64 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:21.937961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2c4d-0d41-46d5-b483-9dde0c409f64 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:21.938954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2c4d-0d41-46d5-b483-9dde0c409f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:21.959765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-532e2c4d-0d41-46d5-b483-9dde0c409f64 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:33:21.960921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-532e2c4d-0d41-46d5-b483-9dde0c409f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:22.025846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1164/2297] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:33:22.041057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:33:22.042452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:22.114652 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ccdbd-4754-4f71-940b-9d44e21d1d4d service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:33:22.120023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:33:22.120640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:22.120914 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:22.121179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:22.129053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:33:22.130635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:33:22.139867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1134/2298] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:33:25.162483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ba873-b728-4373-a1f7-ef6c5e2f5071 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:25.162981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ba873-b728-4373-a1f7-ef6c5e2f5071 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:25.163080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ba873-b728-4373-a1f7-ef6c5e2f5071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:25.183667 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-ec9ba873-b728-4373-a1f7-ef6c5e2f5071 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:33:25.185131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ec9ba873-b728-4373-a1f7-ef6c5e2f5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:25.193095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1165/2299] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:33:25.208972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:33:25.221410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb0af-c1f0-4eae-ab2c-87f343f7c652 service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:33:25.227313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:33:25.227905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:25.228182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:25.228489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:25.237322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:33:25.238883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:33:25.248125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1135/2300] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:33:29.265790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af0e8f-1c35-464c-a2a8-b5ce038c0aa4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:29.266298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af0e8f-1c35-464c-a2a8-b5ce038c0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:29.266400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af0e8f-1c35-464c-a2a8-b5ce038c0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:29.285363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d0af0e8f-1c35-464c-a2a8-b5ce038c0aa4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:33:29.286563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d0af0e8f-1c35-464c-a2a8-b5ce038c0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:29.295427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1166/2301] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:33:29.312524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:33:29.323837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7b7b6-a83d-4ef9-84f1-5b218c4a74dd service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:33:29.329511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26997a-2a6f-43fc-b35a-121501b5a1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:33:29.330304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26997a-2a6f-43fc-b35a-121501b5a1a4 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:29.330589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26997a-2a6f-43fc-b35a-121501b5a1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:29.330860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26997a-2a6f-43fc-b35a-121501b5a1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:29.339647 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26997a-2a6f-43fc-b35a-121501b5a1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:33:29.341579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26997a-2a6f-43fc-b35a-121501b5a1a4 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:33:29.352479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1136/2302] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:33:29.925462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298fb3-113c-4f09-ba05-894631e51d29 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:29.925734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298fb3-113c-4f09-ba05-894631e51d29 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:29.926007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298fb3-113c-4f09-ba05-894631e51d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:29.944690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c7298fb3-113c-4f09-ba05-894631e51d29 None None] MFA Rules not processed for user `7dd2273d28c14633bd62e590171dac31`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:33:29.945883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c7298fb3-113c-4f09-ba05-894631e51d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:29.999768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1167/2303] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:33:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:33:32.425199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac3428-8ec1-4fca-ae44-2f7272d88c56 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:32.425655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac3428-8ec1-4fca-ae44-2f7272d88c56 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:32.425746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac3428-8ec1-4fca-ae44-2f7272d88c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:32.446155 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-86ac3428-8ec1-4fca-ae44-2f7272d88c56 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:33:32.447348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-86ac3428-8ec1-4fca-ae44-2f7272d88c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:32.455317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1137/2304] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:33:32.474980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298fb3-113c-4f09-ba05-894631e51d29 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:33:32.488239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298fb3-113c-4f09-ba05-894631e51d29 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:33:32.494360 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:33:32.494954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:32.495233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:32.495506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:32.504367 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:33:32.506269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:33:32.516018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1168/2305] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:33:37.657551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a190d-efde-4ff8-88a2-355342475742 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:37.658066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a190d-efde-4ff8-88a2-355342475742 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:37.658168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a190d-efde-4ff8-88a2-355342475742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:37.677229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-fa0a190d-efde-4ff8-88a2-355342475742 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:33:37.678428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fa0a190d-efde-4ff8-88a2-355342475742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:33:37.686471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1138/2306] 10.222.0.44 () {58 vars in 1016 bytes} [Thu Sep 1 00:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:33:37.702242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:33:37.713334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704584-8aba-4bdd-9f49-fca2ce8a09d3 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:33:37.719390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:33:37.720013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:33:37.720295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:33:37.720632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:33:37.728882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:33:37.730496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:33:37.740521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1169/2307] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:33:47.672008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=52 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:47.736255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=70 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:06.941154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1eb9-3a4f-4751-a2e6-e26613cf447f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:06.941688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1eb9-3a4f-4751-a2e6-e26613cf447f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:06.941688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1eb9-3a4f-4751-a2e6-e26613cf447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:06.960726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-98df1eb9-3a4f-4751-a2e6-e26613cf447f None None] MFA Rules not processed for user `562fcce5b9be41908036832d4aed1dff`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:06.961902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-98df1eb9-3a4f-4751-a2e6-e26613cf447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:07.014400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1139/2308] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:08.025804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.027354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:08.041166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d41f-3d13-4fdb-93e9-a679b0f3deed service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.046164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.046794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.047079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.047361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] PATH_INFO: `/v3/users/b714e26a0db64849b0d42f7c8e3db39a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.048576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b714e26a0db64849b0d42f7c8e3db39a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.050714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:08.104041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b714e26a0db64849b0d42f7c8e3db39a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.111761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b714e26a0db64849b0d42f7c8e3db39a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.112472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b714e26a0db64849b0d42f7c8e3db39a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.119627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b714e26a0db64849b0d42f7c8e3db39a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.131792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-8945d8ee-bc66-4538-9afe-1315356bdfff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b714e26a0db64849b0d42f7c8e3db39a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.138579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1170/2309] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:34:08 2022] DELETE /identity/v3/users/b714e26a0db64849b0d42f7c8e3db39a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:34:08.312624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df1eb9-3a4f-4751-a2e6-e26613cf447f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.336822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df1eb9-3a4f-4751-a2e6-e26613cf447f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.413706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.414340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.414673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.414872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] PATH_INFO: `/v3/projects/3a5d4bbf88da424f8a84b98603a7d57a` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.416014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5d4bbf88da424f8a84b98603a7d57a)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.417957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:08.490638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5d4bbf88da424f8a84b98603a7d57a', 'request_id': 'req-2d93143d-2cd7-4f99-b329-9081cbe442d2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.498128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5d4bbf88da424f8a84b98603a7d57a', 'request_id': 'req-2d93143d-2cd7-4f99-b329-9081cbe442d2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.505376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5d4bbf88da424f8a84b98603a7d57a', 'request_id': 'req-2d93143d-2cd7-4f99-b329-9081cbe442d2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.524458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] The token cache is being invalidate because project 3a5d4bbf88da424f8a84b98603a7d57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:34:08.524751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.525434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2d93143d-2cd7-4f99-b329-9081cbe442d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:08.527871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1140/2310] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:34:08 2022] DELETE /identity/v3/projects/3a5d4bbf88da424f8a84b98603a7d57a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:08.533169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8c8e-12ab-44bc-be28-f7984a5dd903 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.533459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8c8e-12ab-44bc-be28-f7984a5dd903 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.533761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8c8e-12ab-44bc-be28-f7984a5dd903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.555793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0c9d8c8e-12ab-44bc-be28-f7984a5dd903 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:08.557213 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0c9d8c8e-12ab-44bc-be28-f7984a5dd903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:08.635897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1171/2311] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:08.642550 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e822d-de08-4f78-8f9b-9c4f08b9b225 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.642834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e822d-de08-4f78-8f9b-9c4f08b9b225 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.643106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e822d-de08-4f78-8f9b-9c4f08b9b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.663097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b47e822d-de08-4f78-8f9b-9c4f08b9b225 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:08.664273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b47e822d-de08-4f78-8f9b-9c4f08b9b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:08.672801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1141/2312] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:08.677175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d8c8e-12ab-44bc-be28-f7984a5dd903 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.687570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d8c8e-12ab-44bc-be28-f7984a5dd903 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.694695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.695303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.695586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.695851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.696540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:34:08.696836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.698486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:08.710942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1172/2313] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:34:08.715352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e822d-de08-4f78-8f9b-9c4f08b9b225 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.725448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e822d-de08-4f78-8f9b-9c4f08b9b225 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.733058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.733667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.733969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.734236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.734871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.736853 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:08.765527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1142/2314] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:34:08 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:34:08.769595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.779991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff9db-ff68-439c-87d7-803f940550be admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.855277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.855894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.856172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.856486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.857111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.859009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:08.867343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:08.884064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1173/2315] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:34:08 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:34:08.888752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.899078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c82cd-2425-4b5f-a9f0-2850f2608a1f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.904076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.904736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.905013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.905284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.905958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.907576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:08.909093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:08.919972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1143/2316] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:34:08.923382 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.933546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37ef79-41c3-4bd4-9ab8-2b6ec3bcced1 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.938786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6827-0f1f-4681-b521-352c9815dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.939374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6827-0f1f-4681-b521-352c9815dc1b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.939652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6827-0f1f-4681-b521-352c9815dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.939920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6827-0f1f-4681-b521-352c9815dc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.940590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6827-0f1f-4681-b521-352c9815dc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.942172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6827-0f1f-4681-b521-352c9815dc1b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:08.952767 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1174/2317] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:34:08.956798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:08.967229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ee1fd-a7d2-4c28-9f22-cf3887f962c2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:08.971731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:08.972365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:08.972668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:08.972939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] PATH_INFO: `/v3/projects/a97dd9621dcc41ec8159d1cc3f4c8b3b/users/2799d67d2b744dc6abd630b12a892cf5/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:08.987891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97dd9621dcc41ec8159d1cc3f4c8b3b, user_id=2799d67d2b744dc6abd630b12a892cf5, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:08.990548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:09.003151 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1144/2318] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:34:08 2022] PUT /identity/v3/projects/a97dd9621dcc41ec8159d1cc3f4c8b3b/users/2799d67d2b744dc6abd630b12a892cf5/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:09.014225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14933c-7c9f-41e6-8ceb-229f30c8fd8a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:09.014508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14933c-7c9f-41e6-8ceb-229f30c8fd8a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:09.014780 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14933c-7c9f-41e6-8ceb-229f30c8fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:09.042114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1a14933c-7c9f-41e6-8ceb-229f30c8fd8a None None] MFA Rules not processed for user `2799d67d2b744dc6abd630b12a892cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:09.043923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1a14933c-7c9f-41e6-8ceb-229f30c8fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:09.107314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1175/2319] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:09.118522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:09.120190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:09.175916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e238-5096-4016-8d99-8e7a36fe51f6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:09.179495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343d47-3df0-40c3-a847-c5cfaba2d5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:09.180083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d47-3df0-40c3-a847-c5cfaba2d5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:09.180358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d47-3df0-40c3-a847-c5cfaba2d5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:09.180664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d47-3df0-40c3-a847-c5cfaba2d5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:09.188711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343d47-3df0-40c3-a847-c5cfaba2d5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:09.190129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343d47-3df0-40c3-a847-c5cfaba2d5c6 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:09.198730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1145/2320] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:34:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:34:14.280670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14933c-7c9f-41e6-8ceb-229f30c8fd8a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:14.354598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14933c-7c9f-41e6-8ceb-229f30c8fd8a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:14.359786 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:14.360437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:14.360729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:14.361004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] PATH_INFO: `/v3/users/2799d67d2b744dc6abd630b12a892cf5` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:14.362123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2799d67d2b744dc6abd630b12a892cf5)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:14.364044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:14.415536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2799d67d2b744dc6abd630b12a892cf5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:14.423381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2799d67d2b744dc6abd630b12a892cf5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:14.424165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2799d67d2b744dc6abd630b12a892cf5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:14.432593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2799d67d2b744dc6abd630b12a892cf5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:14.438155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:14.448043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2799d67d2b744dc6abd630b12a892cf5'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:14.454174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1176/2321] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:34:14 2022] DELETE /identity/v3/users/2799d67d2b744dc6abd630b12a892cf5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:14.458599 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:14.459086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:14.459180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:14.479777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:14.481783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:14.545726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1146/2322] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:14.555602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:14.557563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:14.617510 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535cc7c-9266-4a03-bcde-63641313ee3e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:14.621949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf52f7-33cf-4f64-b8a6-b9eea215fb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:14.622644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf52f7-33cf-4f64-b8a6-b9eea215fb50 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:14.623000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf52f7-33cf-4f64-b8a6-b9eea215fb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:14.623346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf52f7-33cf-4f64-b8a6-b9eea215fb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:14.634391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf52f7-33cf-4f64-b8a6-b9eea215fb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:14.635926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf52f7-33cf-4f64-b8a6-b9eea215fb50 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:14.649216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1177/2323] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:34:14.920835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:14.922921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:14.939426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd734c-77ca-448b-9e6e-267482b19b90 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:14.945087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:14.946115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:14.946389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:14.946733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] PATH_INFO: `/v3/projects/a97dd9621dcc41ec8159d1cc3f4c8b3b` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:14.948184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97dd9621dcc41ec8159d1cc3f4c8b3b)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:14.950217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:15.001060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97dd9621dcc41ec8159d1cc3f4c8b3b', 'request_id': 'req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:15.007891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97dd9621dcc41ec8159d1cc3f4c8b3b', 'request_id': 'req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:15.014588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97dd9621dcc41ec8159d1cc3f4c8b3b', 'request_id': 'req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:15.023051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:15.029448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] The token cache is being invalidate because project a97dd9621dcc41ec8159d1cc3f4c8b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:34:15.029942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:15.031070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-93bfae38-e02c-4711-b76c-bc64ae8b3c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:15.036498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1147/2324] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:34:14 2022] DELETE /identity/v3/projects/a97dd9621dcc41ec8159d1cc3f4c8b3b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:16.837021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:16.837555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:16.837687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:16.857035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] MFA Rules not processed for user `77cdd85bff5d4911b351f34b2e13c5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:16.858228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:16.911176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1178/2325] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:34:25.041750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:26.904697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=56,keystone:DELETE=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:35.739427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:35.740016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:35.740016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:35.760056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] MFA Rules not processed for user `bca116e3c8de4cf2aac77028c7e40a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:35.761326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:35.818343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1148/2326] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:45.811519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=25 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:48.523369 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:48.524406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:48.585509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe44f9d-6a28-44ab-afae-86329e6f4ba0 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:48.589303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:48.590536 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:48.590911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:48.591246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:48.593202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:48.657582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:48.658936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:48.668960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1179/2327] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:34:49.562173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:49.565174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:49.583875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca12b4-679f-4e2f-9639-da16fb12559d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:49.588752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:49.589375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:49.590152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:49.590409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] PATH_INFO: `/v3/users/7dd2273d28c14633bd62e590171dac31` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:49.591516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd2273d28c14633bd62e590171dac31)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:49.593465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:49.645686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd2273d28c14633bd62e590171dac31'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:49.654724 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd2273d28c14633bd62e590171dac31'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:49.664302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd2273d28c14633bd62e590171dac31'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:49.664984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd2273d28c14633bd62e590171dac31'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:49.665583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-dce2c567-3ca5-475c-9b3a-3a9de3638e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd2273d28c14633bd62e590171dac31'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:49.683840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1149/2328] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:34:49 2022] DELETE /identity/v3/users/7dd2273d28c14633bd62e590171dac31 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:49.856789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:49.870172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fa367-3188-4e17-854b-c593cff09e1c service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:49.928499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:49.929129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:49.929407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:49.929677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] PATH_INFO: `/v3/projects/0db9ba050d9647369cf0df7d835a524a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:49.930792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db9ba050d9647369cf0df7d835a524a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:49.932730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:49.979127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db9ba050d9647369cf0df7d835a524a', 'request_id': 'req-7f02e87e-df1b-418e-86cf-35abc27f66e1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:49.980965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:49.985505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db9ba050d9647369cf0df7d835a524a', 'request_id': 'req-7f02e87e-df1b-418e-86cf-35abc27f66e1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:49.993783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db9ba050d9647369cf0df7d835a524a', 'request_id': 'req-7f02e87e-df1b-418e-86cf-35abc27f66e1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:50.004000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] The token cache is being invalidate because project 0db9ba050d9647369cf0df7d835a524a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:34:50.004284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:50.004935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7f02e87e-df1b-418e-86cf-35abc27f66e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:50.006413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1180/2329] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:34:49 2022] DELETE /identity/v3/projects/0db9ba050d9647369cf0df7d835a524a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:50.013007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fd7dd-76f9-4fc6-ba99-d759a7b76709 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.013294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fd7dd-76f9-4fc6-ba99-d759a7b76709 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.013557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fd7dd-76f9-4fc6-ba99-d759a7b76709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.033469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-744fd7dd-76f9-4fc6-ba99-d759a7b76709 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:50.034661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-744fd7dd-76f9-4fc6-ba99-d759a7b76709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:50.093122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1150/2330] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:50.100859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb5f7-d5b2-44c4-b8ff-96b012354b84 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.101148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb5f7-d5b2-44c4-b8ff-96b012354b84 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.101422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb5f7-d5b2-44c4-b8ff-96b012354b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.124215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-db6fb5f7-d5b2-44c4-b8ff-96b012354b84 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:50.125467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-db6fb5f7-d5b2-44c4-b8ff-96b012354b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:50.133437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1181/2331] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:50.138184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fd7dd-76f9-4fc6-ba99-d759a7b76709 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:50.148294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fd7dd-76f9-4fc6-ba99-d759a7b76709 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:50.153169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:50.153773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.154050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.154313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.154959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:34:50.155262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:50.156912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:50.168685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1151/2332] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:34:50.172974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fb5f7-d5b2-44c4-b8ff-96b012354b84 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:50.182407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fb5f7-d5b2-44c4-b8ff-96b012354b84 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:50.187665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:50.188362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.188737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.189074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.189769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:50.191729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:50.221035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1182/2333] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:34:50 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:34:50.226154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:50.236436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1edfc-4762-4592-92a7-f1cd5daacb06 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:50.291273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:50.291861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.292135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.292425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.293052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:50.294960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:50.302781 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:50.322093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1152/2334] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:34:50 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:34:50.323251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:50.334130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da8f9f-5742-4f5c-b219-be55c7102fe1 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:50.338979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:50.339605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.339939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.340207 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.340877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:50.342465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:50.352535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1183/2335] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:34:50.356339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:50.366088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e48b-18c5-44bd-a870-1dbb39c91e12 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:50.370594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615b98-b7a1-4a51-a95b-ada2648f357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:50.371967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615b98-b7a1-4a51-a95b-ada2648f357c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.372256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615b98-b7a1-4a51-a95b-ada2648f357c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.372541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615b98-b7a1-4a51-a95b-ada2648f357c admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.373183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615b98-b7a1-4a51-a95b-ada2648f357c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:50.374770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615b98-b7a1-4a51-a95b-ada2648f357c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:50.385482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1153/2336] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:34:50.390406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:50.400259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee71fc-c637-4153-b545-50f6ac20c8fd admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:50.404896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:50.405538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.405819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.406092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] PATH_INFO: `/v3/projects/8d134fd87327418c855a12d3f534c668/users/9e797f32b56e4e1dba922fee8767b656/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.420240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d134fd87327418c855a12d3f534c668, user_id=9e797f32b56e4e1dba922fee8767b656, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:50.422913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:50.436759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1184/2337] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:34:50 2022] PUT /identity/v3/projects/8d134fd87327418c855a12d3f534c668/users/9e797f32b56e4e1dba922fee8767b656/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:50.446803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.447087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.447362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.474850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] MFA Rules not processed for user `9e797f32b56e4e1dba922fee8767b656`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:50.476320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:50.540003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1154/2338] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:50.551126 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:50.552967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:50.609574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f16df1-aa21-4a05-960b-e11345adf0fe admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:50.613184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:50.613784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:50.614094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:50.614364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:50.623077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:50.624523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:50.633117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1185/2339] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:34:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:34:51.653326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:51.654748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:51.712308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d3bbd-5b04-4c39-bb3b-524a9d42e9cd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:51.715905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:51.716477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:51.716753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:51.717020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:51.718686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:51.785763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:51.787178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:51.797668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1155/2340] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:34:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:34:52.024779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:52.026308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:52.037655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774a812-2cc1-40a1-aff2-f849de74cd03 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:52.041333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ac381-413d-40cf-8bac-1cfcc2c71c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:52.041933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ac381-413d-40cf-8bac-1cfcc2c71c7b service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:52.042214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ac381-413d-40cf-8bac-1cfcc2c71c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:52.042486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ac381-413d-40cf-8bac-1cfcc2c71c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:52.044726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2c2ac381-413d-40cf-8bac-1cfcc2c71c7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:52.058047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ac381-413d-40cf-8bac-1cfcc2c71c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:52.060163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ac381-413d-40cf-8bac-1cfcc2c71c7b service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:52.071228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1186/2341] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:34:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:34:59.298036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:59.307580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:59.361067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbc8d4-5a0e-4318-bb13-7193c983c49c service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:59.365687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:59.366307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:59.366583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:59.366848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] PATH_INFO: `/v3/users/9e797f32b56e4e1dba922fee8767b656` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:59.368036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e797f32b56e4e1dba922fee8767b656)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:59.369986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:59.420106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e797f32b56e4e1dba922fee8767b656'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:59.427237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e797f32b56e4e1dba922fee8767b656'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:59.434878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e797f32b56e4e1dba922fee8767b656'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:59.435627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e797f32b56e4e1dba922fee8767b656'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:59.436541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e797f32b56e4e1dba922fee8767b656'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:34:59.455429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1156/2342] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:34:59 2022] DELETE /identity/v3/users/9e797f32b56e4e1dba922fee8767b656 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:34:59.459801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:59.460286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:59.460432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:59.479396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:34:59.481136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:59.552450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1187/2343] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:34:59.561346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:34:59.562894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:34:59.652201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405cd5-5233-4283-b652-d2ceea975b91 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:34:59.658229 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301da71-3349-4191-a0cb-33b8aa52de6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:34:59.659209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301da71-3349-4191-a0cb-33b8aa52de6c service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:34:59.659666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301da71-3349-4191-a0cb-33b8aa52de6c service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:34:59.660038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301da71-3349-4191-a0cb-33b8aa52de6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:34:59.680877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301da71-3349-4191-a0cb-33b8aa52de6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:34:59.682559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301da71-3349-4191-a0cb-33b8aa52de6c service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:34:59.695673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1157/2344] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:35:00.001793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.003306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:00.019631 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23681a-f58d-43f0-955a-5d144ba460e4 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.025358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.026028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.026318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.026584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] PATH_INFO: `/v3/projects/8d134fd87327418c855a12d3f534c668` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.028686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d134fd87327418c855a12d3f534c668)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.030621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.032754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:00.083366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d134fd87327418c855a12d3f534c668', 'request_id': 'req-f387a58e-36f1-41a8-968c-5a1fbfee73b8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:00.101142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d134fd87327418c855a12d3f534c668', 'request_id': 'req-f387a58e-36f1-41a8-968c-5a1fbfee73b8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:00.110125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d134fd87327418c855a12d3f534c668', 'request_id': 'req-f387a58e-36f1-41a8-968c-5a1fbfee73b8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:00.121413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] The token cache is being invalidate because project 8d134fd87327418c855a12d3f534c668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:00.121707 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:00.122375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f387a58e-36f1-41a8-968c-5a1fbfee73b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:00.124036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1188/2345] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:00 2022] DELETE /identity/v3/projects/8d134fd87327418c855a12d3f534c668 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:00.128975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d403-9a9d-471c-a54f-7d3689cc16a2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.129259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d403-9a9d-471c-a54f-7d3689cc16a2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.129531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d403-9a9d-471c-a54f-7d3689cc16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.149436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d263d403-9a9d-471c-a54f-7d3689cc16a2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:00.151031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d263d403-9a9d-471c-a54f-7d3689cc16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:00.178191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:00.215723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1158/2346] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:35:00.224439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb35cf-f539-4958-a0fb-9fc92f377625 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.224752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb35cf-f539-4958-a0fb-9fc92f377625 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.225028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb35cf-f539-4958-a0fb-9fc92f377625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.245171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1edb35cf-f539-4958-a0fb-9fc92f377625 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:00.246512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1edb35cf-f539-4958-a0fb-9fc92f377625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:00.255236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1189/2347] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:00.259442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d403-9a9d-471c-a54f-7d3689cc16a2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.269733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d403-9a9d-471c-a54f-7d3689cc16a2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.274382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.274976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.275262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.275535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.276182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:35:00.276516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.278778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.290417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1159/2348] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:35:00.295188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb35cf-f539-4958-a0fb-9fc92f377625 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.304855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb35cf-f539-4958-a0fb-9fc92f377625 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.310095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.310700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.311033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.311353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.312095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.314123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.342958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1190/2349] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:00.346981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.357407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e653b-a997-4a81-8100-58cfb06b107c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.412858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.413448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.413722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.413992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.414604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.416532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.437000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1160/2350] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:00.441122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.451710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff543ff-4c0c-4715-b3b6-bd10a4c4fe50 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.456427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.457022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.457299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.457572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.458242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.459867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.470283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1191/2351] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:00.473917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.483697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238266f-377e-4cb3-a063-d115a8925f2d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.488231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb278e6c-1fea-4d73-9fa2-7a4a71192e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.488850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278e6c-1fea-4d73-9fa2-7a4a71192e92 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.489125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278e6c-1fea-4d73-9fa2-7a4a71192e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.489393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278e6c-1fea-4d73-9fa2-7a4a71192e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.490023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb278e6c-1fea-4d73-9fa2-7a4a71192e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.491612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb278e6c-1fea-4d73-9fa2-7a4a71192e92 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.501874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1161/2352] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:00.505803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.516338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4e76-b476-43f2-b88e-23913bf744cb admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.521031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.521678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.521962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.522241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] PATH_INFO: `/v3/projects/6cdf195a4a084caebd6fdd05c4fbbe9c/users/bdf355aa40d34214881ee8ac70b2b8c6/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.537591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdf195a4a084caebd6fdd05c4fbbe9c, user_id=bdf355aa40d34214881ee8ac70b2b8c6, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.540236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.552674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1192/2353] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:00 2022] PUT /identity/v3/projects/6cdf195a4a084caebd6fdd05c4fbbe9c/users/bdf355aa40d34214881ee8ac70b2b8c6/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:00.563498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72d560-8161-4ffb-875c-790a0cb60e40 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.563780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72d560-8161-4ffb-875c-790a0cb60e40 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.564070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72d560-8161-4ffb-875c-790a0cb60e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.591405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2e72d560-8161-4ffb-875c-790a0cb60e40 None None] MFA Rules not processed for user `bdf355aa40d34214881ee8ac70b2b8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:00.592665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2e72d560-8161-4ffb-875c-790a0cb60e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:00.655008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1162/2354] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:00.659332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.723005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f329ec2-2cdb-4f5f-a19f-ef154bb9c2fd admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.727914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae260-ca17-4a18-a9f2-fbd8569e7082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.728557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae260-ca17-4a18-a9f2-fbd8569e7082 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.728840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae260-ca17-4a18-a9f2-fbd8569e7082 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.729113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae260-ca17-4a18-a9f2-fbd8569e7082 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.729752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae260-ca17-4a18-a9f2-fbd8569e7082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.731650 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae260-ca17-4a18-a9f2-fbd8569e7082 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.768511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1193/2355] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:00.771324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72d560-8161-4ffb-875c-790a0cb60e40 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.781490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72d560-8161-4ffb-875c-790a0cb60e40 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.801879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad5b6-89da-4013-b14d-3fa808d34e66 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.802397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad5b6-89da-4013-b14d-3fa808d34e66 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.802397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad5b6-89da-4013-b14d-3fa808d34e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.806715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:00.821938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3bdad5b6-89da-4013-b14d-3fa808d34e66 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:00.823132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3bdad5b6-89da-4013-b14d-3fa808d34e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:00.829215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:00.844162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.844792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.845067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.845337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.845961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.847919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.869795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1163/2356] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/users => generated 308 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:00.874193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.883464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1194/2357] 10.222.0.13 () {58 vars in 967 bytes} [Thu Sep 1 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:35:00.883604 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962c8e-d343-4755-b5b9-2f9cc3f43386 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.889099 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.889689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.889980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.890241 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.890880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.892701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.903366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1164/2358] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:35:00.907684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdad5b6-89da-4013-b14d-3fa808d34e66 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.920246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdad5b6-89da-4013-b14d-3fa808d34e66 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:00.925226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:00.925887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:00.926166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:00.926498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] PATH_INFO: `/v3/projects/4f3fa1ef530941b6ab36649dca203f33/users/f8301c8f331c4198a14cc49de218ac12/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:00.931384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:00.933258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:00.946621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3fa1ef530941b6ab36649dca203f33, user_id=f8301c8f331c4198a14cc49de218ac12, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:00.949925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:00.967428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1195/2359] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:00 2022] PUT /identity/v3/projects/4f3fa1ef530941b6ab36649dca203f33/users/f8301c8f331c4198a14cc49de218ac12/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:00.971323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:01.018089 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a144ff-fbbb-4ab0-b5cf-44c0019dff8e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:01.035221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f850-16d9-4286-a5d7-3ff517bdcc6f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:01.039853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:01.040484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.040763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.041034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.041663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:01.043837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:01.056131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1196/2360] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:35:01.060932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:01.071247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43211ad-1d90-4642-835a-f4dfb81ed18d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:01.076561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46787d5a-27ba-44b0-9d43-ab9ef0476f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:01.077208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787d5a-27ba-44b0-9d43-ab9ef0476f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.077485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787d5a-27ba-44b0-9d43-ab9ef0476f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.077756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787d5a-27ba-44b0-9d43-ab9ef0476f90 admin admin] PATH_INFO: `/v3/projects/4f3fa1ef530941b6ab36649dca203f33/users/f8301c8f331c4198a14cc49de218ac12/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.079609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787d5a-27ba-44b0-9d43-ab9ef0476f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3fa1ef530941b6ab36649dca203f33, user_id=f8301c8f331c4198a14cc49de218ac12, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:01.081703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:01.082251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787d5a-27ba-44b0-9d43-ab9ef0476f90 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:01.082370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.082579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.082850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.093364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1197/2361] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:01 2022] PUT /identity/v3/projects/4f3fa1ef530941b6ab36649dca203f33/users/f8301c8f331c4198a14cc49de218ac12/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:01.104689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503547c8-a2c8-40cc-9569-4102171d7dde None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.104977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503547c8-a2c8-40cc-9569-4102171d7dde None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.105762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503547c8-a2c8-40cc-9569-4102171d7dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.129753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:01.133252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-503547c8-a2c8-40cc-9569-4102171d7dde None None] MFA Rules not processed for user `f8301c8f331c4198a14cc49de218ac12`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:01.134486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-503547c8-a2c8-40cc-9569-4102171d7dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:01.140866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:01.142510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:01.150588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1165/2362] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:35:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 00:35:01.200702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:01.204968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1198/2363] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:01 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:35:01.215570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:01.217207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:01.279840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58772a-bf5c-40e5-b23e-153a075b2dad service swift] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:01.331255 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c7b44-cc8c-4b67-843c-94451214939e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:01.331891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c7b44-cc8c-4b67-843c-94451214939e service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.332166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c7b44-cc8c-4b67-843c-94451214939e service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.332472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c7b44-cc8c-4b67-843c-94451214939e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.342277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c7b44-cc8c-4b67-843c-94451214939e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:01.343706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c7b44-cc8c-4b67-843c-94451214939e service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:01.353831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1166/2364] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:01 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:01.645199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503547c8-a2c8-40cc-9569-4102171d7dde None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:01.711041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503547c8-a2c8-40cc-9569-4102171d7dde None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:01.716604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:01.717242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.717519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.717790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] PATH_INFO: `/v3/users/bdf355aa40d34214881ee8ac70b2b8c6` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.718923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf355aa40d34214881ee8ac70b2b8c6)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:01.720896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:01.768967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf355aa40d34214881ee8ac70b2b8c6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:01.776374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf355aa40d34214881ee8ac70b2b8c6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:01.777732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf355aa40d34214881ee8ac70b2b8c6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:01.787507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf355aa40d34214881ee8ac70b2b8c6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:01.801219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf355aa40d34214881ee8ac70b2b8c6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:01.807441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1199/2365] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:01 2022] DELETE /identity/v3/users/bdf355aa40d34214881ee8ac70b2b8c6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:01.812128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82941247-0939-4869-8838-677ab0f1adfd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.812450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82941247-0939-4869-8838-677ab0f1adfd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.812728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82941247-0939-4869-8838-677ab0f1adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.832815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-82941247-0939-4869-8838-677ab0f1adfd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:01.834056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-82941247-0939-4869-8838-677ab0f1adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:01.896813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1167/2366] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:01.907594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:01.909086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:01.966807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e966c-707e-40b8-8c04-bf5711073066 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:01.970547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:01.971157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:01.971432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:01.971696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:01.981815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:01.983259 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:01.993037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1200/2367] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:02.266895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82941247-0939-4869-8838-677ab0f1adfd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:02.268536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-82941247-0939-4869-8838-677ab0f1adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:02.280623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82941247-0939-4869-8838-677ab0f1adfd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:02.286204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:02.286795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:02.287060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:02.287417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] PATH_INFO: `/v3/projects/6cdf195a4a084caebd6fdd05c4fbbe9c` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:02.289796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdf195a4a084caebd6fdd05c4fbbe9c)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:02.291778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:02.338860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:02.343792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdf195a4a084caebd6fdd05c4fbbe9c', 'request_id': 'req-a241f9a6-9066-40be-93b3-8a117dcc936f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.351169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdf195a4a084caebd6fdd05c4fbbe9c', 'request_id': 'req-a241f9a6-9066-40be-93b3-8a117dcc936f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.357041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdf195a4a084caebd6fdd05c4fbbe9c', 'request_id': 'req-a241f9a6-9066-40be-93b3-8a117dcc936f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.370490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] The token cache is being invalidate because project 6cdf195a4a084caebd6fdd05c4fbbe9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:02.370777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.371893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.373722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1168/2368] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:02 2022] DELETE /identity/v3/projects/6cdf195a4a084caebd6fdd05c4fbbe9c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:02.377456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:02.388255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b1257-98b0-453c-81d1-e8cb8490916b service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:02.413893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:02.461492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:02.462309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:02.462652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:02.462938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] PATH_INFO: `/v3/users/f8301c8f331c4198a14cc49de218ac12` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:02.464446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8301c8f331c4198a14cc49de218ac12)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:02.466680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:02.520263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8301c8f331c4198a14cc49de218ac12'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.529042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8301c8f331c4198a14cc49de218ac12'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.529804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8301c8f331c4198a14cc49de218ac12'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.537874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8301c8f331c4198a14cc49de218ac12'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.552543 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-92ac93e2-d018-468c-b64a-187d3dfdbee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8301c8f331c4198a14cc49de218ac12'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:02.559125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1201/2369] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:02 2022] DELETE /identity/v3/users/f8301c8f331c4198a14cc49de218ac12 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:02.874027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:02.875754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:02.892703 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f9a6-9066-40be-93b3-8a117dcc936f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:02.951772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:02.952423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:02.952702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:02.952972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] PATH_INFO: `/v3/projects/4f3fa1ef530941b6ab36649dca203f33` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:02.954496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3fa1ef530941b6ab36649dca203f33)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:02.956427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.006367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3fa1ef530941b6ab36649dca203f33', 'request_id': 'req-2a6e4335-07c5-48e8-97bd-05ab79a75801'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:03.013525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3fa1ef530941b6ab36649dca203f33', 'request_id': 'req-2a6e4335-07c5-48e8-97bd-05ab79a75801'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:03.018984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3fa1ef530941b6ab36649dca203f33', 'request_id': 'req-2a6e4335-07c5-48e8-97bd-05ab79a75801'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:03.032752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] The token cache is being invalidate because project 4f3fa1ef530941b6ab36649dca203f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:03.032976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:03.033596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2a6e4335-07c5-48e8-97bd-05ab79a75801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:03.035088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1169/2370] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:02 2022] DELETE /identity/v3/projects/4f3fa1ef530941b6ab36649dca203f33 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:03.040052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500af0-9420-4258-8da5-ce9b2df5fcc9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.040554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500af0-9420-4258-8da5-ce9b2df5fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.040729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500af0-9420-4258-8da5-ce9b2df5fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.061820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-52500af0-9420-4258-8da5-ce9b2df5fcc9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:03.063030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-52500af0-9420-4258-8da5-ce9b2df5fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:03.127195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1202/2371] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:03.134892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5342b-0bc8-4b21-81e6-f0935b7cbd36 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.135426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5342b-0bc8-4b21-81e6-f0935b7cbd36 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.135767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5342b-0bc8-4b21-81e6-f0935b7cbd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.156786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-18d5342b-0bc8-4b21-81e6-f0935b7cbd36 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:03.158077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-18d5342b-0bc8-4b21-81e6-f0935b7cbd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:03.171044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1170/2372] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:03.175201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52500af0-9420-4258-8da5-ce9b2df5fcc9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:03.185425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52500af0-9420-4258-8da5-ce9b2df5fcc9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:03.190189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:03.190902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.191176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.191446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.192087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:35:03.192399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:03.194011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.208740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1203/2373] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:35:03.213051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5342b-0bc8-4b21-81e6-f0935b7cbd36 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:03.225305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5342b-0bc8-4b21-81e6-f0935b7cbd36 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:03.231086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:03.231272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.231596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.232044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.232930 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:03.235092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.270096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1171/2374] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:03 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:03.271246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:03.285933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58147f2-e009-44c7-aedc-d3cb85e3e37b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:03.314232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:03.352979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:03.353208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.353474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.353746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.354374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:03.356344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.384753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1204/2375] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:03 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:03.385934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:03.398649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f2793-a5ad-4896-89f0-46f74f43d5c2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:03.404162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:03.404936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.405439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.406031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.406571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:03.408322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.419332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1172/2376] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:03.423174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:03.433626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba2ef-76b3-4326-9cff-318f8c88e180 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:03.439474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452dfc4-d72f-4810-b02f-f2b4db6e0e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:03.440084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452dfc4-d72f-4810-b02f-f2b4db6e0e61 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.440363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452dfc4-d72f-4810-b02f-f2b4db6e0e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.440664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452dfc4-d72f-4810-b02f-f2b4db6e0e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.441300 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452dfc4-d72f-4810-b02f-f2b4db6e0e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:03.442900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452dfc4-d72f-4810-b02f-f2b4db6e0e61 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.454848 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1205/2377] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:03.459147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:03.472748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dd5e8-5ce3-4353-8392-fb5088ca629c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:03.479041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:03.479822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.480211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.480586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] PATH_INFO: `/v3/projects/b569b485275b4bb9b4eb09e83d34e1fb/users/c179c83a156b4a2b9a18bdca1b35aada/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.498115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b569b485275b4bb9b4eb09e83d34e1fb, user_id=c179c83a156b4a2b9a18bdca1b35aada, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:03.501041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.517406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:03.529725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1173/2378] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:03 2022] PUT /identity/v3/projects/b569b485275b4bb9b4eb09e83d34e1fb/users/c179c83a156b4a2b9a18bdca1b35aada/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:03.534233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3678-9b00-4e51-accc-18dacb4c51d2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.534517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3678-9b00-4e51-accc-18dacb4c51d2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.534789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3678-9b00-4e51-accc-18dacb4c51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.554538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-32ae3678-9b00-4e51-accc-18dacb4c51d2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:03.555675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-32ae3678-9b00-4e51-accc-18dacb4c51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:03.623285 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1206/2379] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:03.633711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:03.637553 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:03.705612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f0d0-b44e-4f40-9b46-e0c341561ec9 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:03.709864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:03.710711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:03.710906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:03.711169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:03.730170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:03.731648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:03.743591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1174/2380] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:04.468045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d19e3-f682-4d58-a107-3b3a8444a9a8 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:04.468671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d19e3-f682-4d58-a107-3b3a8444a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:04.468671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d19e3-f682-4d58-a107-3b3a8444a9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:04.500762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e99d19e3-f682-4d58-a107-3b3a8444a9a8 None None] MFA Rules not processed for user `c179c83a156b4a2b9a18bdca1b35aada`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:04.502128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e99d19e3-f682-4d58-a107-3b3a8444a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:04.628496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1207/2381] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:04.630682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:04.641921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502f99-7c10-488d-b4a7-9484425bf025 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:04.646886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:04.648583 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:04.649072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:04.649627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:04.650806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:04.653522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:04.688367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1175/2382] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:04 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:04.689903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d19e3-f682-4d58-a107-3b3a8444a9a8 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:04.709933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d19e3-f682-4d58-a107-3b3a8444a9a8 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:04.759934 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:04.792913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:04.794164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:04.794615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:04.795042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:04.795872 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:04.798119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:04.825027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1208/2383] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:04 2022] POST /identity/v3/users => generated 308 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:04.827385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:04.839202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a366-11e0-4196-90dc-8e5840fa1133 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:04.845308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:04.846126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:04.846568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:04.846996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:04.847825 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:04.849653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:04.868865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1176/2384] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:04.880274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:04.894297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36dbc0-2d42-4bc4-8ec4-94e1b1781bcf admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:04.900398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:04.901026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:04.901225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:04.901494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] PATH_INFO: `/v3/projects/26d04602f9dd483d84406e8ccec13c3a/users/a4e3dea713d64b69b40ac8319047452f/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:04.929602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d04602f9dd483d84406e8ccec13c3a, user_id=a4e3dea713d64b69b40ac8319047452f, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:04.932713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:04.955727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1209/2385] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:04 2022] PUT /identity/v3/projects/26d04602f9dd483d84406e8ccec13c3a/users/a4e3dea713d64b69b40ac8319047452f/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:04.959592 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:04.976275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb522e-e3be-471a-b59a-02ef6d64d58d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:05.053963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:05.054555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:05.054998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:05.055444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:05.056083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:05.057752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:05.071278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1177/2386] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:05.076154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:05.090898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3a667-038a-426f-82ee-72024a506970 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:05.091372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42408e-312b-44c5-b617-33be769b565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:05.092046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42408e-312b-44c5-b617-33be769b565e admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:05.092328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42408e-312b-44c5-b617-33be769b565e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:05.092734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42408e-312b-44c5-b617-33be769b565e admin admin] PATH_INFO: `/v3/projects/26d04602f9dd483d84406e8ccec13c3a/users/a4e3dea713d64b69b40ac8319047452f/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:05.094748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42408e-312b-44c5-b617-33be769b565e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d04602f9dd483d84406e8ccec13c3a, user_id=a4e3dea713d64b69b40ac8319047452f, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:05.097437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42408e-312b-44c5-b617-33be769b565e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:05.108936 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1210/2387] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:05 2022] PUT /identity/v3/projects/26d04602f9dd483d84406e8ccec13c3a/users/a4e3dea713d64b69b40ac8319047452f/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:05.695570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:05.697699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:05.812911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:05.823556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7914-6cd3-48c8-b4b8-cacd79d9b8bf admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:05.898811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:05.899426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:05.899710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:05.899983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:05.906606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:05.979751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:05.981470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:05.991417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1178/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:06.062074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1202318-902a-476d-be6b-75649c73f388 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:06.062556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1202318-902a-476d-be6b-75649c73f388 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:06.063340 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1202318-902a-476d-be6b-75649c73f388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:06.101635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e1202318-902a-476d-be6b-75649c73f388 None None] MFA Rules not processed for user `a4e3dea713d64b69b40ac8319047452f`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:06.105813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e1202318-902a-476d-be6b-75649c73f388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:06.226032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1211/2389] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:06 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:07.801032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:07.879611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efeaed-26a1-4c03-9008-d60d93ab5f5a service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:07.888488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:07.889156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:07.889492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:07.889845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] PATH_INFO: `/v3/users/c179c83a156b4a2b9a18bdca1b35aada` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:07.891152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c179c83a156b4a2b9a18bdca1b35aada)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:07.893446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:07.940649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:07.947617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c179c83a156b4a2b9a18bdca1b35aada'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:07.956420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c179c83a156b4a2b9a18bdca1b35aada'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:07.965251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c179c83a156b4a2b9a18bdca1b35aada'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:07.965881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c179c83a156b4a2b9a18bdca1b35aada'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:07.966468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c179c83a156b4a2b9a18bdca1b35aada'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:07.986425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1179/2390] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:07 2022] DELETE /identity/v3/users/c179c83a156b4a2b9a18bdca1b35aada => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:08.161835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1202318-902a-476d-be6b-75649c73f388 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:08.173651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1202318-902a-476d-be6b-75649c73f388 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:08.262862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:08.263504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:08.264105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:08.264391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] PATH_INFO: `/v3/projects/b569b485275b4bb9b4eb09e83d34e1fb` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:08.265976 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b569b485275b4bb9b4eb09e83d34e1fb)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:08.268256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:08.289427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:08.328493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b569b485275b4bb9b4eb09e83d34e1fb', 'request_id': 'req-38481ec2-3023-43cc-8816-8fd06d114cf0'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.335714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b569b485275b4bb9b4eb09e83d34e1fb', 'request_id': 'req-38481ec2-3023-43cc-8816-8fd06d114cf0'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.344932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b569b485275b4bb9b4eb09e83d34e1fb', 'request_id': 'req-38481ec2-3023-43cc-8816-8fd06d114cf0'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.358115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] The token cache is being invalidate because project b569b485275b4bb9b4eb09e83d34e1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:08.358407 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.359062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.361308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1212/2391] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:08 2022] DELETE /identity/v3/projects/b569b485275b4bb9b4eb09e83d34e1fb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:08.366154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:08.367616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:08.381888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aa22b-3c42-4eec-97a3-f10149fcca48 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:08.445832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:08.446551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:08.446783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:08.447040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] PATH_INFO: `/v3/users/a4e3dea713d64b69b40ac8319047452f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:08.448161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e3dea713d64b69b40ac8319047452f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:08.450733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:08.534016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e3dea713d64b69b40ac8319047452f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.545655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e3dea713d64b69b40ac8319047452f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.563744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e3dea713d64b69b40ac8319047452f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.564752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e3dea713d64b69b40ac8319047452f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.565797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3715906a-09a1-4df4-ab57-20170ab9c02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e3dea713d64b69b40ac8319047452f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:08.595731 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1180/2392] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:08 2022] DELETE /identity/v3/users/a4e3dea713d64b69b40ac8319047452f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:08.827736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:08.830809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:08.854203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38481ec2-3023-43cc-8816-8fd06d114cf0 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:08.936527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:08.937535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:08.938054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:08.938555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] PATH_INFO: `/v3/projects/26d04602f9dd483d84406e8ccec13c3a` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:08.940089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d04602f9dd483d84406e8ccec13c3a)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:08.943257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.044548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d04602f9dd483d84406e8ccec13c3a', 'request_id': 'req-1bb92a77-3d1b-41e6-836d-4773f98429f8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.053859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d04602f9dd483d84406e8ccec13c3a', 'request_id': 'req-1bb92a77-3d1b-41e6-836d-4773f98429f8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.065886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d04602f9dd483d84406e8ccec13c3a', 'request_id': 'req-1bb92a77-3d1b-41e6-836d-4773f98429f8'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.078983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] The token cache is being invalidate because project 26d04602f9dd483d84406e8ccec13c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:09.079284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.080253 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.084519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1213/2393] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:08 2022] DELETE /identity/v3/projects/26d04602f9dd483d84406e8ccec13c3a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:09.086969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc8ec2-eb02-4589-9cdb-b8c5ee428fab None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.087447 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc8ec2-eb02-4589-9cdb-b8c5ee428fab None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.087531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc8ec2-eb02-4589-9cdb-b8c5ee428fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.117738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-cbbc8ec2-eb02-4589-9cdb-b8c5ee428fab None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:09.120371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-cbbc8ec2-eb02-4589-9cdb-b8c5ee428fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.140686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.143077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.169988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:09.193109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:09.223394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb92a77-3d1b-41e6-836d-4773f98429f8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.228539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1181/2394] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:09.233256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beeddc-13e7-4385-b61f-d0ee26b60ff6 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.233541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beeddc-13e7-4385-b61f-d0ee26b60ff6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.233816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beeddc-13e7-4385-b61f-d0ee26b60ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.235103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.235806 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.236186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.236555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] PATH_INFO: `/v3/users/fd96430c5667411e8d8c7825d09e95cf` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.238326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd96430c5667411e8d8c7825d09e95cf)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.240346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.255138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-53beeddc-13e7-4385-b61f-d0ee26b60ff6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:09.256357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-53beeddc-13e7-4385-b61f-d0ee26b60ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.265457 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1182/2395] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:09.270749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53beeddc-13e7-4385-b61f-d0ee26b60ff6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.281419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53beeddc-13e7-4385-b61f-d0ee26b60ff6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.286269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.286840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.287111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.287375 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.288005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:35:09.288297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.289904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.292054 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd96430c5667411e8d8c7825d09e95cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.300003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd96430c5667411e8d8c7825d09e95cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.300805 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd96430c5667411e8d8c7825d09e95cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.310017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1183/2396] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:35:09.310204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd96430c5667411e8d8c7825d09e95cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.311308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.321627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c433a0-9a12-4eb2-8d29-65fb496b2d03 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.321764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd96430c5667411e8d8c7825d09e95cf'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.327080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.327655 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.327938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.328072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1214/2397] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:09 2022] DELETE /identity/v3/users/fd96430c5667411e8d8c7825d09e95cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:09.331200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.331881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.333838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.362367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1184/2398] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:09 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:09.366547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.367997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.436405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063f171-1438-4be6-897f-e14e1d3a1d67 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.497635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.500800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.500800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.500800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.500800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.502017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.503419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.504120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.514189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:09.521095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeeb1c-36ef-47ec-87b9-796a032bd5a9 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.529489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.530359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.530841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.531864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] PATH_INFO: `/v3/projects/4fa1ea00378d4512b6f2520e8b292903` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.533137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa1ea00378d4512b6f2520e8b292903)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.535279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.540575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1215/2399] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:09 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:09.544444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.554088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a500ec3-2241-44cf-87dc-80c3240e1e17 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.559199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.559776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.560047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.560311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.560973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.562561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.577341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1216/2400] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:35:09.578311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.587878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf2d56-625c-4cc9-b8f6-157633fc3de2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.588887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa1ea00378d4512b6f2520e8b292903', 'request_id': 'req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.595405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa1ea00378d4512b6f2520e8b292903', 'request_id': 'req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.601611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa1ea00378d4512b6f2520e8b292903', 'request_id': 'req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.615190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] The token cache is being invalidate because project 4fa1ea00378d4512b6f2520e8b292903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:09.615506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.616523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.618490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1185/2401] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:09 2022] DELETE /identity/v3/projects/4fa1ea00378d4512b6f2520e8b292903 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:09.622794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.624098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.653412 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.654132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.654413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.654685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.655320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.657089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.667094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1217/2402] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:09.671503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.673381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.686210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae5b9-9ebe-4195-9bfb-fdc59e38d0db admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.689137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4a28f-b56a-40c3-a64a-13502f4d2b15 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.690953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032ef19-af5c-4390-8064-7f64f10c017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.691591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032ef19-af5c-4390-8064-7f64f10c017b admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.691874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032ef19-af5c-4390-8064-7f64f10c017b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.692147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032ef19-af5c-4390-8064-7f64f10c017b admin admin] PATH_INFO: `/v3/projects/977e724133234c1bbd5b04199c537a85/users/ad18e617b5714b748a89429aebd8c41c/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.693816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.694434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.694708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.694981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] PATH_INFO: `/v3/users/fb96e703c2b54653845657f672c3bdea` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.696117 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb96e703c2b54653845657f672c3bdea)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.698101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.707716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032ef19-af5c-4390-8064-7f64f10c017b admin admin] RBAC: Authorizing `identity:create_grant(project_id=977e724133234c1bbd5b04199c537a85, user_id=ad18e617b5714b748a89429aebd8c41c, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.710845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032ef19-af5c-4390-8064-7f64f10c017b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.723044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:09.727381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1218/2403] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:09 2022] PUT /identity/v3/projects/977e724133234c1bbd5b04199c537a85/users/ad18e617b5714b748a89429aebd8c41c/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:09.738327 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534e25-b5b3-45f8-8f0d-b3161a0cddfc None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.738872 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534e25-b5b3-45f8-8f0d-b3161a0cddfc None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.739146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534e25-b5b3-45f8-8f0d-b3161a0cddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.754001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb96e703c2b54653845657f672c3bdea'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.760887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb96e703c2b54653845657f672c3bdea'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.768334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-9d534e25-b5b3-45f8-8f0d-b3161a0cddfc None None] MFA Rules not processed for user `ad18e617b5714b748a89429aebd8c41c`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:09.768929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb96e703c2b54653845657f672c3bdea'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.769552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb96e703c2b54653845657f672c3bdea'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.769666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9d534e25-b5b3-45f8-8f0d-b3161a0cddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.770185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb96e703c2b54653845657f672c3bdea'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:09.791327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1186/2404] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:09 2022] DELETE /identity/v3/users/fb96e703c2b54653845657f672c3bdea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:09.835265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1219/2405] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:35:09.839291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.840827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:09.906813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eee4cc-db4c-4122-827e-f6a5e08422a7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:09.911495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:09.912102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:09.912400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:09.912681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:09.913323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:09.915237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:09.944043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1187/2406] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:09 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:09.947887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534e25-b5b3-45f8-8f0d-b3161a0cddfc None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.970028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:09.972324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:10.013886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:10.033411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534e25-b5b3-45f8-8f0d-b3161a0cddfc None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.038110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.038715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.038991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.039264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.039914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.040465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f6237-fd0d-4071-a9b9-ce0a7a497f78 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.041860 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.045718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.046343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.046625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.046897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] PATH_INFO: `/v3/projects/b27eab5cb3814e05b770f03bc56d1f5c` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.048015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27eab5cb3814e05b770f03bc56d1f5c)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.049963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.064332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1220/2407] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:09 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:10.068565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:10.081244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c45a1-0022-47ee-93ff-e00cafeb7e37 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.083784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:10.085945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.086531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.086811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.087107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.087816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.089502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.105947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1221/2408] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:35:10.106797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:10.108057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27eab5cb3814e05b770f03bc56d1f5c', 'request_id': 'req-57216fb8-6239-4796-ae8c-c5b82df24691'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.117228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af87f1d-6659-46aa-9582-b2bdddc25383 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.118784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27eab5cb3814e05b770f03bc56d1f5c', 'request_id': 'req-57216fb8-6239-4796-ae8c-c5b82df24691'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.126545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27eab5cb3814e05b770f03bc56d1f5c', 'request_id': 'req-57216fb8-6239-4796-ae8c-c5b82df24691'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.146929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] The token cache is being invalidate because project b27eab5cb3814e05b770f03bc56d1f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:10.147454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.148542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.150545 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1188/2409] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:09 2022] DELETE /identity/v3/projects/b27eab5cb3814e05b770f03bc56d1f5c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:10.187140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.187854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.188137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.188437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] PATH_INFO: `/v3/projects/c3e719b5aabd499f8f9ab1a80a06dca1/users/24133de673da4c1a8cc0c1e3f70a79bc/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.207850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e719b5aabd499f8f9ab1a80a06dca1, user_id=24133de673da4c1a8cc0c1e3f70a79bc, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.211234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.231302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1222/2410] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:10 2022] PUT /identity/v3/projects/c3e719b5aabd499f8f9ab1a80a06dca1/users/24133de673da4c1a8cc0c1e3f70a79bc/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:10.235495 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:10.237158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:10.252324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57216fb8-6239-4796-ae8c-c5b82df24691 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.318337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8ce9c-1e5a-4410-bd51-bf2815923958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.319238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8ce9c-1e5a-4410-bd51-bf2815923958 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.319524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8ce9c-1e5a-4410-bd51-bf2815923958 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.319874 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8ce9c-1e5a-4410-bd51-bf2815923958 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.320659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8ce9c-1e5a-4410-bd51-bf2815923958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.322786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8ce9c-1e5a-4410-bd51-bf2815923958 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.335671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1189/2411] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:10.340671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:10.352169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290695-7db3-44aa-b268-8110ea799147 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.358347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.359082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.359410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.359720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] PATH_INFO: `/v3/projects/c3e719b5aabd499f8f9ab1a80a06dca1/users/24133de673da4c1a8cc0c1e3f70a79bc/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.361729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e719b5aabd499f8f9ab1a80a06dca1, user_id=24133de673da4c1a8cc0c1e3f70a79bc, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.364483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.379010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1223/2412] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:10 2022] PUT /identity/v3/projects/c3e719b5aabd499f8f9ab1a80a06dca1/users/24133de673da4c1a8cc0c1e3f70a79bc/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:10.392053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8002b-f5ae-42e0-8355-fc7d8a1aa23c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.392815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8002b-f5ae-42e0-8355-fc7d8a1aa23c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.393093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8002b-f5ae-42e0-8355-fc7d8a1aa23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.433957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ebd8002b-f5ae-42e0-8355-fc7d8a1aa23c None None] MFA Rules not processed for user `24133de673da4c1a8cc0c1e3f70a79bc`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:10.435232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ebd8002b-f5ae-42e0-8355-fc7d8a1aa23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:10.503261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1190/2413] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:10.515196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:10.516886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:10.573209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8d4a4-5fcf-406c-8a58-a0b7eef92577 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.577475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08022de4-fbda-4c9e-8de6-fa95fc8e247c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.578070 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08022de4-fbda-4c9e-8de6-fa95fc8e247c service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.578350 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08022de4-fbda-4c9e-8de6-fa95fc8e247c service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.578622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08022de4-fbda-4c9e-8de6-fa95fc8e247c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.587531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08022de4-fbda-4c9e-8de6-fa95fc8e247c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.588980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08022de4-fbda-4c9e-8de6-fa95fc8e247c service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.598476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1224/2414] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:10.627188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8002b-f5ae-42e0-8355-fc7d8a1aa23c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:10.666710 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:10.692124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8002b-f5ae-42e0-8355-fc7d8a1aa23c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.696777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.697395 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.697671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.697940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] PATH_INFO: `/v3/users/ad18e617b5714b748a89429aebd8c41c` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.699752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad18e617b5714b748a89429aebd8c41c)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.701756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.747586 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad18e617b5714b748a89429aebd8c41c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.754399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad18e617b5714b748a89429aebd8c41c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.761619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad18e617b5714b748a89429aebd8c41c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.762245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad18e617b5714b748a89429aebd8c41c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.762862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad18e617b5714b748a89429aebd8c41c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:10.779380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1191/2415] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:10 2022] DELETE /identity/v3/users/ad18e617b5714b748a89429aebd8c41c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:10.783791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.784073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.784366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.803296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:10.804648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:10.833825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:10.864698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1225/2416] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:35:10.875075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:10.876491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:10.930988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d4268-2d0a-4830-9273-45db376f0acb admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:10.935165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:10.935751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:10.936025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:10.936290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:10.944986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:10.946394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:10.955529 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1192/2417] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:11.223011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:11.225801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:11.242146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dd6b8-cf5f-4fa6-a633-c18072827685 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:11.247460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:11.248087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:11.248366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:11.248706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] PATH_INFO: `/v3/projects/977e724133234c1bbd5b04199c537a85` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:11.249898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=977e724133234c1bbd5b04199c537a85)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:11.251790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:11.298584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977e724133234c1bbd5b04199c537a85', 'request_id': 'req-41ca8a07-2a1a-4b47-ad34-ff49e670a176'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.305034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977e724133234c1bbd5b04199c537a85', 'request_id': 'req-41ca8a07-2a1a-4b47-ad34-ff49e670a176'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.311944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977e724133234c1bbd5b04199c537a85', 'request_id': 'req-41ca8a07-2a1a-4b47-ad34-ff49e670a176'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.322146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] The token cache is being invalidate because project 977e724133234c1bbd5b04199c537a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:11.322440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.323072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.324599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1226/2418] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:11 2022] DELETE /identity/v3/projects/977e724133234c1bbd5b04199c537a85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:11.328560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:11.338123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fddfb-8d1b-4b70-b1a9-f821d9919d7a service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:11.389148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:11.397125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:11.397973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:11.398441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:11.398973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] PATH_INFO: `/v3/users/24133de673da4c1a8cc0c1e3f70a79bc` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:11.400248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24133de673da4c1a8cc0c1e3f70a79bc)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:11.402794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:11.461369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24133de673da4c1a8cc0c1e3f70a79bc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.469455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24133de673da4c1a8cc0c1e3f70a79bc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.477693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24133de673da4c1a8cc0c1e3f70a79bc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.478490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24133de673da4c1a8cc0c1e3f70a79bc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.479096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-aab66fc9-7e7d-4ef2-8324-8e5229e8af10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24133de673da4c1a8cc0c1e3f70a79bc'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.496598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1193/2419] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:11 2022] DELETE /identity/v3/users/24133de673da4c1a8cc0c1e3f70a79bc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:11.848286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:11.849760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:11.863701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca8a07-2a1a-4b47-ad34-ff49e670a176 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:11.926007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:11.926639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:11.926920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:11.927190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] PATH_INFO: `/v3/projects/c3e719b5aabd499f8f9ab1a80a06dca1` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:11.928312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e719b5aabd499f8f9ab1a80a06dca1)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:11.930247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:11.976219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e719b5aabd499f8f9ab1a80a06dca1', 'request_id': 'req-1839799d-939f-4b52-b61d-b90de99aa692'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.982538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e719b5aabd499f8f9ab1a80a06dca1', 'request_id': 'req-1839799d-939f-4b52-b61d-b90de99aa692'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:11.986311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:11.989545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e719b5aabd499f8f9ab1a80a06dca1', 'request_id': 'req-1839799d-939f-4b52-b61d-b90de99aa692'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:12.002699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] The token cache is being invalidate because project c3e719b5aabd499f8f9ab1a80a06dca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:12.002974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:12.003614 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1839799d-939f-4b52-b61d-b90de99aa692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:12.005228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1227/2420] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:11 2022] DELETE /identity/v3/projects/c3e719b5aabd499f8f9ab1a80a06dca1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:12.010380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff97ce-8a95-46c1-9cf6-eff706b917ad None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.010664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff97ce-8a95-46c1-9cf6-eff706b917ad None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.011060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff97ce-8a95-46c1-9cf6-eff706b917ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.031161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4aff97ce-8a95-46c1-9cf6-eff706b917ad None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:12.032377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4aff97ce-8a95-46c1-9cf6-eff706b917ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:12.090596 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1194/2421] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:12.098249 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c542b-58cc-4b9e-a7bf-b41dba53d7ec None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.098534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c542b-58cc-4b9e-a7bf-b41dba53d7ec None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.098840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c542b-58cc-4b9e-a7bf-b41dba53d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.119204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-506c542b-58cc-4b9e-a7bf-b41dba53d7ec None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:12.120930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-506c542b-58cc-4b9e-a7bf-b41dba53d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:12.130068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1228/2422] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:12.134220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff97ce-8a95-46c1-9cf6-eff706b917ad None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.144493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff97ce-8a95-46c1-9cf6-eff706b917ad None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.149551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.150135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.150407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.150675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.151317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:35:12.151630 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.153253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.164674 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1195/2423] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:35:12.169474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c542b-58cc-4b9e-a7bf-b41dba53d7ec None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.178628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c542b-58cc-4b9e-a7bf-b41dba53d7ec None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.183705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.184288 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.184596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.184865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.185482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.187355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.214102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1229/2424] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:12.218258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.229007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85289270-83aa-4084-95d5-9dea38825c44 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.283914 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.284538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.284814 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.285080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.285729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.287626 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.297883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:12.312955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1196/2425] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:12.314110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.324266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f23e0-ba38-43b8-bf1c-142ab51ac08d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.328801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.329389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.329663 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.329930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.330558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.332176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.341928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1230/2426] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:35:12.345826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.356311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9c98-fe05-487b-bdea-4f6f0f0319b5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.360823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d135137-0372-4d1b-91ac-7023ef100747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.361428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135137-0372-4d1b-91ac-7023ef100747 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.361700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135137-0372-4d1b-91ac-7023ef100747 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.361972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135137-0372-4d1b-91ac-7023ef100747 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.362601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d135137-0372-4d1b-91ac-7023ef100747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.364183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d135137-0372-4d1b-91ac-7023ef100747 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.375513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1197/2427] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:12.379292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.389149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381713bd-a15f-48a7-8323-2e7e3fa117ec admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.393691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.394321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.394597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.394864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] PATH_INFO: `/v3/projects/18a7c447ae1f43f69aaf5bc155965e55/users/2007320af481480384c135638610828a/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.410618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a7c447ae1f43f69aaf5bc155965e55, user_id=2007320af481480384c135638610828a, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.413389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.427211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1231/2428] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:12 2022] PUT /identity/v3/projects/18a7c447ae1f43f69aaf5bc155965e55/users/2007320af481480384c135638610828a/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:12.439363 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49922e-a800-4ac4-9908-7e0d629058b4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.439667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49922e-a800-4ac4-9908-7e0d629058b4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.439940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49922e-a800-4ac4-9908-7e0d629058b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.467130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ba49922e-a800-4ac4-9908-7e0d629058b4 None None] MFA Rules not processed for user `2007320af481480384c135638610828a`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:12.468347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ba49922e-a800-4ac4-9908-7e0d629058b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:12.532794 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1198/2429] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:12.537542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.598854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9ac0-f130-4dc5-abd9-58ea11221df3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.603777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.604365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.604693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.605539 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.606164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.608055 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.633635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1232/2430] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:12.637912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49922e-a800-4ac4-9908-7e0d629058b4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.649644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49922e-a800-4ac4-9908-7e0d629058b4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.709657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.710259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.710531 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.710798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.711430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.713365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.742300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1199/2431] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:12.746381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.757024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b67495-5c05-41b3-8480-7ec998d195eb admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.761895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.762498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.762778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.763049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.763687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.765425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.776298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1233/2432] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:12.780917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.790673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6fef2-3e71-4d6d-b969-58319e72b61d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.795851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dec6f-9068-4fba-9b18-17cce71642a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.796468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dec6f-9068-4fba-9b18-17cce71642a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.796746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dec6f-9068-4fba-9b18-17cce71642a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.797014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dec6f-9068-4fba-9b18-17cce71642a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.805477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dec6f-9068-4fba-9b18-17cce71642a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.807100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dec6f-9068-4fba-9b18-17cce71642a9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.818507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1200/2433] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:12.822917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:12.832863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536f8f-8fe2-4ef0-97f7-cb75c7cf9117 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:12.837578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:12.838251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.838525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.838792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] PATH_INFO: `/v3/projects/90c653e64eae470ab051f43efb2256d9/users/2b8541878ba740288261ce3ab69b1f52/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.854252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c653e64eae470ab051f43efb2256d9, user_id=2b8541878ba740288261ce3ab69b1f52, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:12.857473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:12.870639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1234/2434] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:12 2022] PUT /identity/v3/projects/90c653e64eae470ab051f43efb2256d9/users/2b8541878ba740288261ce3ab69b1f52/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:12.880638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992bde-69e0-4be7-a5da-cab408249669 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:12.880926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992bde-69e0-4be7-a5da-cab408249669 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:12.881199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992bde-69e0-4be7-a5da-cab408249669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:12.910253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-f0992bde-69e0-4be7-a5da-cab408249669 None None] MFA Rules not processed for user `2b8541878ba740288261ce3ab69b1f52`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:12.911463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f0992bde-69e0-4be7-a5da-cab408249669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:12.950848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:12.975682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1201/2435] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:12.980131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:13.013818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:13.042045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616f4a-8a56-4a2c-b5d5-4d596e3c36d0 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:13.046589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:13.047186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.047459 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.047726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.048354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:13.050273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:13.075713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1235/2436] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:12 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:13.079761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0992bde-69e0-4be7-a5da-cab408249669 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:13.091345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0992bde-69e0-4be7-a5da-cab408249669 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:13.148143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:13.148774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.149046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.149313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.149938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:13.152539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:13.174552 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1202/2437] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:13 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:13.178834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:13.189601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b33e43-6413-492d-b757-395facff9402 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:13.194212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:13.194840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.195122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.195393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.196064 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:13.197718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:13.210087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1236/2438] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:13.215232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:13.227300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696ffd-1a7b-4f4f-aecd-f6144f383715 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:13.233096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:13.233750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.234034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.234804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] PATH_INFO: `/v3/projects/a8c3b7cc54334e93a90474d3a732b50e/users/d8c4e535831142c3bc645942506332d7/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.250659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c3b7cc54334e93a90474d3a732b50e, user_id=d8c4e535831142c3bc645942506332d7, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:13.253342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:13.267377 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1203/2439] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:13 2022] PUT /identity/v3/projects/a8c3b7cc54334e93a90474d3a732b50e/users/d8c4e535831142c3bc645942506332d7/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:13.271447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:13.282655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb936e-1bcc-409e-8c24-70a779315755 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:13.339597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd93bb-ff29-495f-ac20-419f89b5057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:13.340256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd93bb-ff29-495f-ac20-419f89b5057b admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.340492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd93bb-ff29-495f-ac20-419f89b5057b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.340761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd93bb-ff29-495f-ac20-419f89b5057b admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.341396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd93bb-ff29-495f-ac20-419f89b5057b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:13.342987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd93bb-ff29-495f-ac20-419f89b5057b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:13.353376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1237/2440] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:13.357627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:13.367797 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471d44-26d6-460e-9f94-2ce01c073d73 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:13.373119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:13.373869 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.374208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.374542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] PATH_INFO: `/v3/projects/a8c3b7cc54334e93a90474d3a732b50e/users/d8c4e535831142c3bc645942506332d7/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.376574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c3b7cc54334e93a90474d3a732b50e, user_id=d8c4e535831142c3bc645942506332d7, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:13.379264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:13.390324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1204/2441] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:13 2022] PUT /identity/v3/projects/a8c3b7cc54334e93a90474d3a732b50e/users/d8c4e535831142c3bc645942506332d7/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:13.400546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.400837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.401117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.429132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] MFA Rules not processed for user `d8c4e535831142c3bc645942506332d7`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:13.430357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:13.501089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1238/2442] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:13.513482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:13.516993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:13.578118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d99ea-51f6-4e7a-a179-97df586c802a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:13.582186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:13.582787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:13.583061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:13.583326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:13.629156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:13.642233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:13.643871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:13.653215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1205/2443] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:35:15.161566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:15.163038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:15.175171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b98f2-263f-4764-a718-f86965e6ef94 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:15.178818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:15.179420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:15.179699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:15.179972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:15.208222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:15.241188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:15.242630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:15.252166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1239/2444] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:15.764128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:15.772822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73018f-4a84-45a7-908f-43fccd203d6b service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:15.776984 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:15.777555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:15.777827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:15.778088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:15.786886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:15.788297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:15.799144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1206/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:18.658963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:18.660550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:18.754937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9f99-ce6a-4c08-989f-0d32cbb51a05 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:18.760579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892a64-b594-481c-ae9a-e12d8c9fede5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:18.761177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892a64-b594-481c-ae9a-e12d8c9fede5 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:18.761452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892a64-b594-481c-ae9a-e12d8c9fede5 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:18.761722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892a64-b594-481c-ae9a-e12d8c9fede5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:18.763455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-60892a64-b594-481c-ae9a-e12d8c9fede5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:18.822682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892a64-b594-481c-ae9a-e12d8c9fede5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:18.824758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892a64-b594-481c-ae9a-e12d8c9fede5 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:18.835842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1240/2446] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:19.810645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:19.875234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0cdbd-eb95-40d8-981e-3bcf19dcf126 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:19.880213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:19.881006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:19.881358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:19.881702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] PATH_INFO: `/v3/users/2007320af481480384c135638610828a` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:19.882940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2007320af481480384c135638610828a)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:19.885044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:19.940515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2007320af481480384c135638610828a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:19.947283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2007320af481480384c135638610828a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:19.955087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2007320af481480384c135638610828a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:19.955943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2007320af481480384c135638610828a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:19.956665 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2007320af481480384c135638610828a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:19.974340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1207/2447] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:19 2022] DELETE /identity/v3/users/2007320af481480384c135638610828a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:19.979307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:19.979800 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:19.979907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:20.001940 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:20.003143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:20.064443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1241/2448] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:20.073934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:20.075955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:20.133890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432dd1b-5186-4c79-8d24-fecb67da7ff6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:20.138212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:20.138803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:20.139078 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:20.139345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:20.146405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:20.148822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:20.150711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:20.162129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1208/2449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:20.449139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:20.451339 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:20.467337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:20.472358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c15bb0-219d-4cbc-9c89-5bffa53fd929 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:20.480368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:20.481645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:20.482028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:20.482494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] PATH_INFO: `/v3/projects/18a7c447ae1f43f69aaf5bc155965e55` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:20.484182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a7c447ae1f43f69aaf5bc155965e55)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:20.486532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:20.543116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a7c447ae1f43f69aaf5bc155965e55', 'request_id': 'req-2a127de6-c52d-4a2b-be4c-de08b7e214f3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.552882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a7c447ae1f43f69aaf5bc155965e55', 'request_id': 'req-2a127de6-c52d-4a2b-be4c-de08b7e214f3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.562385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a7c447ae1f43f69aaf5bc155965e55', 'request_id': 'req-2a127de6-c52d-4a2b-be4c-de08b7e214f3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.573953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] The token cache is being invalidate because project 18a7c447ae1f43f69aaf5bc155965e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:20.574947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.575843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.578091 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1242/2450] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:20 2022] DELETE /identity/v3/projects/18a7c447ae1f43f69aaf5bc155965e55 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:20.582983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:20.593084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ece45-d6d6-407e-8e3d-8d949c5910b1 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:20.649489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:20.650113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:20.650389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:20.650656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] PATH_INFO: `/v3/users/2b8541878ba740288261ce3ab69b1f52` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:20.651799 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8541878ba740288261ce3ab69b1f52)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:20.654313 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:20.702976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8541878ba740288261ce3ab69b1f52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.709751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8541878ba740288261ce3ab69b1f52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.717904 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8541878ba740288261ce3ab69b1f52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.718564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8541878ba740288261ce3ab69b1f52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.719180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8541878ba740288261ce3ab69b1f52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:20.736739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1209/2451] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:20 2022] DELETE /identity/v3/users/2b8541878ba740288261ce3ab69b1f52 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:21.022835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:21.024733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:21.050885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127de6-c52d-4a2b-be4c-de08b7e214f3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:21.119096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:21.119765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:21.120044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:21.120310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] PATH_INFO: `/v3/projects/90c653e64eae470ab051f43efb2256d9` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:21.121552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c653e64eae470ab051f43efb2256d9)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:21.123643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:21.182979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c653e64eae470ab051f43efb2256d9', 'request_id': 'req-d24db1a9-6a76-4465-8e83-3db8507e8d34'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.189289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c653e64eae470ab051f43efb2256d9', 'request_id': 'req-d24db1a9-6a76-4465-8e83-3db8507e8d34'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.197086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c653e64eae470ab051f43efb2256d9', 'request_id': 'req-d24db1a9-6a76-4465-8e83-3db8507e8d34'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.210384 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] The token cache is being invalidate because project 90c653e64eae470ab051f43efb2256d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:21.210801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.211573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.213128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1243/2452] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:21 2022] DELETE /identity/v3/projects/90c653e64eae470ab051f43efb2256d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:21.218183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:21.219658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:21.233978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b11a3d-8217-4aa5-9dc4-2c135c0897d1 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:21.292031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:21.292707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:21.292989 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:21.293790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] PATH_INFO: `/v3/users/d8c4e535831142c3bc645942506332d7` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:21.294922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c4e535831142c3bc645942506332d7)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:21.296931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:21.313508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:21.350739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c4e535831142c3bc645942506332d7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.359601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c4e535831142c3bc645942506332d7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.369244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c4e535831142c3bc645942506332d7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.370023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c4e535831142c3bc645942506332d7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.370827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-6536ec33-b174-4f93-9d8f-cc0a27d32cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c4e535831142c3bc645942506332d7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.393162 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1210/2453] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:21 2022] DELETE /identity/v3/users/d8c4e535831142c3bc645942506332d7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:21.669730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:21.671254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:21.684195 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db1a9-6a76-4465-8e83-3db8507e8d34 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:21.699616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:21.755388 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:21.756029 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:21.756308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:21.756975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] PATH_INFO: `/v3/projects/a8c3b7cc54334e93a90474d3a732b50e` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:21.757921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c3b7cc54334e93a90474d3a732b50e)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:21.759874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:21.817432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c3b7cc54334e93a90474d3a732b50e', 'request_id': 'req-2134e380-14d6-48e7-af9b-5f51eb822441'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.825273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c3b7cc54334e93a90474d3a732b50e', 'request_id': 'req-2134e380-14d6-48e7-af9b-5f51eb822441'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.833990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c3b7cc54334e93a90474d3a732b50e', 'request_id': 'req-2134e380-14d6-48e7-af9b-5f51eb822441'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.846669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] The token cache is being invalidate because project a8c3b7cc54334e93a90474d3a732b50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:21.847035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.847606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:21.852487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1244/2454] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:21 2022] DELETE /identity/v3/projects/a8c3b7cc54334e93a90474d3a732b50e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:22.087303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:22.087905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:22.088240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:22.109004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:22.110128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:22.171105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1211/2455] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:35:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:22.183719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:22.185156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:22.267379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134e380-14d6-48e7-af9b-5f51eb822441 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:22.273083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:22.273801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:22.274075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:22.274997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:22.284463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:22.286128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:22.294719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1245/2456] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:35:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:35:32.162925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=9,keystone:SELECT=45,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:32.291082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:32.870585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:32.872079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:32.932185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902f921-d64c-415a-9442-4c8bf5f86676 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:32.935897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:32.936372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:32.936689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:32.936960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:32.938708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:32.948371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:32.949866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:32.958206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1212/2457] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:35:33.973130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:33.975220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:34.071408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a14d9-4680-4ef2-9bf0-600e8df74051 service swift] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:34.085266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46ab25-9c1b-4083-bc48-228434888e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:34.086847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46ab25-9c1b-4083-bc48-228434888e50 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:34.087137 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46ab25-9c1b-4083-bc48-228434888e50 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:34.087460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46ab25-9c1b-4083-bc48-228434888e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:34.089759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bc46ab25-9c1b-4083-bc48-228434888e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:34.108045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46ab25-9c1b-4083-bc48-228434888e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:34.125538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46ab25-9c1b-4083-bc48-228434888e50 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:34.141463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1246/2458] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:37.137230 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:37.139565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:37.158261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d111f9-53a4-4c4b-8795-75501a0d292e service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:37.168856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff3842-d2ae-47d4-a770-bb9f0c29ec6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:37.169881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3842-d2ae-47d4-a770-bb9f0c29ec6e service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:37.170364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3842-d2ae-47d4-a770-bb9f0c29ec6e service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:37.170851 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3842-d2ae-47d4-a770-bb9f0c29ec6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:37.172920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-eaff3842-d2ae-47d4-a770-bb9f0c29ec6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:37.186372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff3842-d2ae-47d4-a770-bb9f0c29ec6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:37.188607 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff3842-d2ae-47d4-a770-bb9f0c29ec6e service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:37.202228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1213/2459] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:37.938133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a669e5-5daf-411b-8896-c10b5a38a8e3 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:37.938690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a669e5-5daf-411b-8896-c10b5a38a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:37.938690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a669e5-5daf-411b-8896-c10b5a38a8e3 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:37.940060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1247/2460] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:35:37.945917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e21f6-96f2-4d26-8d82-db625b075915 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:37.946204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e21f6-96f2-4d26-8d82-db625b075915 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:37.946435 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e21f6-96f2-4d26-8d82-db625b075915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:37.967369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6a8e21f6-96f2-4d26-8d82-db625b075915 None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:37.968610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6a8e21f6-96f2-4d26-8d82-db625b075915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:37.978272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1214/2461] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:35:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:37.989872 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a669e5-5daf-411b-8896-c10b5a38a8e3 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:37.991578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a6a669e5-5daf-411b-8896-c10b5a38a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:38.050524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a669e5-5daf-411b-8896-c10b5a38a8e3 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:38.054163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ee9ef-c134-4fd5-86a7-1ef848c64dc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:38.054773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ee9ef-c134-4fd5-86a7-1ef848c64dc7 service glance] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.055048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ee9ef-c134-4fd5-86a7-1ef848c64dc7 service glance] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.055315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ee9ef-c134-4fd5-86a7-1ef848c64dc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.082638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ee9ef-c134-4fd5-86a7-1ef848c64dc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:38.084094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ee9ef-c134-4fd5-86a7-1ef848c64dc7 service glance] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:38.095748 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1248/2462] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:38.165839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b861-3fa0-41a9-a96d-5cabbce558c3 None None] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.166425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b861-3fa0-41a9-a96d-5cabbce558c3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.166425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b861-3fa0-41a9-a96d-5cabbce558c3 None None] PATH_INFO: `/` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.167698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1215/2463] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:35:38.172321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9d5d8-1e2c-4331-9d2f-19642d00aded None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.172636 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9d5d8-1e2c-4331-9d2f-19642d00aded None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.172911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9d5d8-1e2c-4331-9d2f-19642d00aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.192718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-aac9d5d8-1e2c-4331-9d2f-19642d00aded None None] MFA Rules not processed for user `baa7f3487b674e75afe5fca74db44807`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:38.193918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-aac9d5d8-1e2c-4331-9d2f-19642d00aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:38.201204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1249/2464] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:35:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:38.212661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b861-3fa0-41a9-a96d-5cabbce558c3 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:38.223763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b861-3fa0-41a9-a96d-5cabbce558c3 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:38.228096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f969-4346-426d-96a6-61d6754c9252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:38.228692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f969-4346-426d-96a6-61d6754c9252 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.228968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f969-4346-426d-96a6-61d6754c9252 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.229233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f969-4346-426d-96a6-61d6754c9252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.236397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f969-4346-426d-96a6-61d6754c9252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:38.237822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f969-4346-426d-96a6-61d6754c9252 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:38.246134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1216/2465] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:38.329788 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd733a-a845-45e9-bc00-1785cf57de05 None None] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.330075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd733a-a845-45e9-bc00-1785cf57de05 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.330353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd733a-a845-45e9-bc00-1785cf57de05 None None] PATH_INFO: `/` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.331736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1250/2466] 10.222.0.13 () {54 vars in 921 bytes} [Thu Sep 1 00:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 00:35:38.336440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.336728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.337014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.356466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] MFA Rules not processed for user `c63bab6bcfed4cb3b05de6ad4a4b43a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:38.357654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:38.366807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1217/2467] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Sep 1 00:35:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:38.377492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd733a-a845-45e9-bc00-1785cf57de05 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:38.389102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd733a-a845-45e9-bc00-1785cf57de05 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:38.392879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3881d72-9f87-41bf-a110-f1967ef8dd2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:38.393463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881d72-9f87-41bf-a110-f1967ef8dd2c service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.393737 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881d72-9f87-41bf-a110-f1967ef8dd2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.394003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881d72-9f87-41bf-a110-f1967ef8dd2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.412560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3881d72-9f87-41bf-a110-f1967ef8dd2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:38.413988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3881d72-9f87-41bf-a110-f1967ef8dd2c service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:38.427531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1251/2468] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:38.496547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:38.498142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:38.577635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89befc-f37a-4104-ae95-2bbcbb39e83a None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:38.582702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:38.583297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:38.583594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:38.583848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:38.585666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:38.597250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:38.598901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:38.610954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1218/2469] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:40.374939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:40.375632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073037b-c46a-4bb3-af18-d766775c472c None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:40.375632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073037b-c46a-4bb3-af18-d766775c472c None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:40.376358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073037b-c46a-4bb3-af18-d766775c472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:40.400268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6073037b-c46a-4bb3-af18-d766775c472c None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:40.401655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6073037b-c46a-4bb3-af18-d766775c472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:40.410076 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8ce59-edc4-4cb4-bd8f-f788ac0ca807 service placement] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:40.410875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1252/2470] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Sep 1 00:35:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:40.423475 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:40.424212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:40.424640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:40.425049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:40.427207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:40.435639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073037b-c46a-4bb3-af18-d766775c472c None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:40.445094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:40.447339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:40.462764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1219/2471] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:40.465453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073037b-c46a-4bb3-af18-d766775c472c None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:40.483577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:40.484217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:40.484520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:40.484969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:40.496103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:40.498419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:40.527018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1253/2472] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 00:35:40.953832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:40.955329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:40.972056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a05cb-1e62-4a31-8586-851b422a4377 service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:40.982733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:40.983367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:40.983838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:40.984134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:40.989143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:41.040104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:41.079756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:41.081509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:41.093483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1220/2473] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:45.186458 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:45.188232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:45.213115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bde346-bc68-4fc1-909b-bd2e0df1ce3c service swift] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:45.218944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:45.224609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:45.224939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:45.225455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] PATH_INFO: `/v3/users/77cdd85bff5d4911b351f34b2e13c5f4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:45.227347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cdd85bff5d4911b351f34b2e13c5f4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:45.229815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:45.285545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:45.289297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cdd85bff5d4911b351f34b2e13c5f4'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:45.298082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cdd85bff5d4911b351f34b2e13c5f4'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:45.299024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cdd85bff5d4911b351f34b2e13c5f4'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:45.309184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cdd85bff5d4911b351f34b2e13c5f4'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:45.325248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-68dab2d1-b13f-4337-84cc-12e389f81f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cdd85bff5d4911b351f34b2e13c5f4'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:45.337209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1254/2474] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:35:45 2022] DELETE /identity/v3/users/77cdd85bff5d4911b351f34b2e13c5f4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:45.816848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:45.831682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb529-8ba9-46a6-96b5-d114416af2ca service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:45.902872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:45.903504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:45.903780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:45.904053 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] PATH_INFO: `/v3/projects/b9c1dd8fb1c944d781f8d6b64d998623` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:45.905328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c1dd8fb1c944d781f8d6b64d998623)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:45.907384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:45.976292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c1dd8fb1c944d781f8d6b64d998623', 'request_id': 'req-c3917783-e534-44c3-80f4-1f625fc8113f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:45.996154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c1dd8fb1c944d781f8d6b64d998623', 'request_id': 'req-c3917783-e534-44c3-80f4-1f625fc8113f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:46.009340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c1dd8fb1c944d781f8d6b64d998623', 'request_id': 'req-c3917783-e534-44c3-80f4-1f625fc8113f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:46.024706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] The token cache is being invalidate because project b9c1dd8fb1c944d781f8d6b64d998623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:35:46.025058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:46.025754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c3917783-e534-44c3-80f4-1f625fc8113f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:35:46.030669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1221/2475] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:35:45 2022] DELETE /identity/v3/projects/b9c1dd8fb1c944d781f8d6b64d998623 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:46.033007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611171-3481-4ba6-a4b8-784ab8a375db None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.033347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611171-3481-4ba6-a4b8-784ab8a375db None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.033745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611171-3481-4ba6-a4b8-784ab8a375db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.058051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b8611171-3481-4ba6-a4b8-784ab8a375db None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:46.059290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b8611171-3481-4ba6-a4b8-784ab8a375db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:46.142673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1255/2476] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:46.150291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcc8d-7776-41cc-a6d9-af7bab91ac0f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.150641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcc8d-7776-41cc-a6d9-af7bab91ac0f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.150940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcc8d-7776-41cc-a6d9-af7bab91ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.188824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e9bdcc8d-7776-41cc-a6d9-af7bab91ac0f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:46.191130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e9bdcc8d-7776-41cc-a6d9-af7bab91ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:46.207390 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1222/2477] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:35:46.208974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611171-3481-4ba6-a4b8-784ab8a375db None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.219768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611171-3481-4ba6-a4b8-784ab8a375db None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.225859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.227717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.228410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.229233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.230494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:35:46.231146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.233828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.253744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1256/2478] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:35:46.257777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdcc8d-7776-41cc-a6d9-af7bab91ac0f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.270476 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdcc8d-7776-41cc-a6d9-af7bab91ac0f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.275946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.277425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.277949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.278537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.279378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.282734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.316747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1223/2479] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:46 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:46.320772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.331615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae063c-a455-4581-9d19-b9b1e75a6d77 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.393317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.393926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.394201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.394467 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.395111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.397084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.423620 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1257/2480] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:46 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:46.427877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.439589 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18191-3aa4-485f-a8bc-3d58c2ad6f50 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.444629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.445259 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.445523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.445795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.446467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.448120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.459694 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1224/2481] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:35:46.464292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.475002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433bb2c-65b4-4f1d-abc3-0c26983829d8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.480541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5680c-f17b-4597-bd53-c6a64186fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.481154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5680c-f17b-4597-bd53-c6a64186fe8e admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.481431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5680c-f17b-4597-bd53-c6a64186fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.481704 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5680c-f17b-4597-bd53-c6a64186fe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.482343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5680c-f17b-4597-bd53-c6a64186fe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.483948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5680c-f17b-4597-bd53-c6a64186fe8e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.495818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1258/2482] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:46.500170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.511054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7ca35-ab93-49b6-ab9b-53a4f7a50437 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.516312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.516941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.517214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.517488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] PATH_INFO: `/v3/projects/07b8380b59e842e386aa3fa5f94d76b1/users/361f8fda8710446ab576bcfd4af63fd1/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.536085 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b8380b59e842e386aa3fa5f94d76b1, user_id=361f8fda8710446ab576bcfd4af63fd1, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.538792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.552618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:46.558370 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1225/2483] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:46 2022] PUT /identity/v3/projects/07b8380b59e842e386aa3fa5f94d76b1/users/361f8fda8710446ab576bcfd4af63fd1/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:46.569654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c355-621a-4bdd-b73d-69be2c3605af None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.569969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c355-621a-4bdd-b73d-69be2c3605af None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.570287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c355-621a-4bdd-b73d-69be2c3605af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.601223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-8af1c355-621a-4bdd-b73d-69be2c3605af None None] MFA Rules not processed for user `361f8fda8710446ab576bcfd4af63fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:46.602834 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8af1c355-621a-4bdd-b73d-69be2c3605af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:46.616960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:46.678812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1259/2484] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:46.683344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.770803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fea83-cf55-4e3d-921f-97e4790df262 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.779256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.780977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.781262 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.781535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.782193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.784469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.836660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1226/2485] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:35:46 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:35:46.837866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c355-621a-4bdd-b73d-69be2c3605af None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:46.860141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c355-621a-4bdd-b73d-69be2c3605af None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:46.966166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:46.967053 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:46.967447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:46.967814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:46.968675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:46.970973 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:46.996853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1260/2486] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:35:46 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:35:47.000958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:47.012998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e5b1-d9d4-423c-9ca0-d8c53162c0c1 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:47.017899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:47.018617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:47.018960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:47.019299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:47.020066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:47.021843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:47.039616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1227/2487] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:35:47.040821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:47.051067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8b737-fe0c-4fae-8667-f25d5cfe08e3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:47.055603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:47.056239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:47.056554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:47.056821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] PATH_INFO: `/v3/projects/f53f2ed74a934768a118666099e18bec/users/86a2b043017c4cc98aa4f73f43fab245/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:47.073955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53f2ed74a934768a118666099e18bec, user_id=86a2b043017c4cc98aa4f73f43fab245, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:47.076774 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:47.091532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1261/2488] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:47 2022] PUT /identity/v3/projects/f53f2ed74a934768a118666099e18bec/users/86a2b043017c4cc98aa4f73f43fab245/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:35:47.096176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:47.107066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38eb6a-fb1a-4d19-9923-67066df6f9d4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:47.238836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27d1c-5012-42a1-aaa1-295e1a3fb62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:47.239442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27d1c-5012-42a1-aaa1-295e1a3fb62a admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:47.239718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27d1c-5012-42a1-aaa1-295e1a3fb62a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:47.240031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27d1c-5012-42a1-aaa1-295e1a3fb62a admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:47.240849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27d1c-5012-42a1-aaa1-295e1a3fb62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:47.242662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27d1c-5012-42a1-aaa1-295e1a3fb62a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:47.253941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1228/2489] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:35:47.258526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:47.272060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906d01c-2b71-4ef9-8d65-fc20159445a0 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:47.285939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:47.286637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:47.286901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:47.287176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] PATH_INFO: `/v3/projects/f53f2ed74a934768a118666099e18bec/users/86a2b043017c4cc98aa4f73f43fab245/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:47.289172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53f2ed74a934768a118666099e18bec, user_id=86a2b043017c4cc98aa4f73f43fab245, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:47.291957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:47.303738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1262/2490] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:35:47 2022] PUT /identity/v3/projects/f53f2ed74a934768a118666099e18bec/users/86a2b043017c4cc98aa4f73f43fab245/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:35:47.316257 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04fea-8069-4ec8-808f-69462d492d45 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:47.316571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04fea-8069-4ec8-808f-69462d492d45 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:47.316845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04fea-8069-4ec8-808f-69462d492d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:47.350644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-eda04fea-8069-4ec8-808f-69462d492d45 None None] MFA Rules not processed for user `86a2b043017c4cc98aa4f73f43fab245`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:47.351934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-eda04fea-8069-4ec8-808f-69462d492d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:47.424258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:47.436143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1229/2491] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:47.447485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:47.449814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:47.513882 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff1351-bbf6-4759-bb41-27554df613bb admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:47.517822 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ead7-8885-4b88-8710-4b89dbe11c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:47.518508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ead7-8885-4b88-8710-4b89dbe11c60 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:47.518732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ead7-8885-4b88-8710-4b89dbe11c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:47.518963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ead7-8885-4b88-8710-4b89dbe11c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:47.535027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ead7-8885-4b88-8710-4b89dbe11c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:47.536696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ead7-8885-4b88-8710-4b89dbe11c60 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:47.548427 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1263/2492] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:47.627902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04fea-8069-4ec8-808f-69462d492d45 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:47.643343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04fea-8069-4ec8-808f-69462d492d45 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:47.647228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:47.647934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:47.648528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:47.648908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:47.711233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:47.712715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:47.722402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1230/2493] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:51.244756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f49bd-6e07-4807-b5fb-591d90dfe237 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:51.245828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f49bd-6e07-4807-b5fb-591d90dfe237 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:51.245968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f49bd-6e07-4807-b5fb-591d90dfe237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:51.265037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b50f49bd-6e07-4807-b5fb-591d90dfe237 None None] MFA Rules not processed for user `bca116e3c8de4cf2aac77028c7e40a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:51.266289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b50f49bd-6e07-4807-b5fb-591d90dfe237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:51.272045 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:51.328956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1264/2494] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:35:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:51.672580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:51.674360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:51.752635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0337e3f-c665-4b9b-9b46-ead9fd4e9b92 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:51.756542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:51.757147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:51.757424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:51.757692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:51.759423 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:51.769384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:51.770810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:51.779308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1231/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:35:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:35:54.714824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265883a-4036-42fa-a58a-8d19b6c3f81e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:54.715296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265883a-4036-42fa-a58a-8d19b6c3f81e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:54.715404 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265883a-4036-42fa-a58a-8d19b6c3f81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:54.740188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6265883a-4036-42fa-a58a-8d19b6c3f81e None None] MFA Rules not processed for user `b65fda206995485db38858538d48a176`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:35:54.741398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6265883a-4036-42fa-a58a-8d19b6c3f81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:54.796612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1265/2496] 10.222.0.13 () {58 vars in 967 bytes} [Thu Sep 1 00:35:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:35:54.809417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:35:54.810889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:35:54.880915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace246a-7848-44ea-bf5e-53d6fa9bd896 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:35:54.886809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa11b6-69ee-4bcc-9090-72effc77df82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2ae343d97d49be9d3d6b430a61a48f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:35:54.887433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa11b6-69ee-4bcc-9090-72effc77df82 service swift] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:35:54.887678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa11b6-69ee-4bcc-9090-72effc77df82 service swift] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:35:54.888059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa11b6-69ee-4bcc-9090-72effc77df82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:35:54.896427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa11b6-69ee-4bcc-9090-72effc77df82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:35:54.898109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa11b6-69ee-4bcc-9090-72effc77df82 service swift] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:35:54.906414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1232/2497] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Sep 1 00:35:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 00:36:04.790002 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=45 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:04.903007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=88 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:17.083674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265883a-4036-42fa-a58a-8d19b6c3f81e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:17.146176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265883a-4036-42fa-a58a-8d19b6c3f81e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:17.150683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:17.151310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:17.151625 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:17.151899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] PATH_INFO: `/v3/users/361f8fda8710446ab576bcfd4af63fd1` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:17.153142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361f8fda8710446ab576bcfd4af63fd1)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:17.155071 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:17.199818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361f8fda8710446ab576bcfd4af63fd1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.207152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361f8fda8710446ab576bcfd4af63fd1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.207818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361f8fda8710446ab576bcfd4af63fd1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.214965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361f8fda8710446ab576bcfd4af63fd1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.227228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361f8fda8710446ab576bcfd4af63fd1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.233396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1266/2498] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:17 2022] DELETE /identity/v3/users/361f8fda8710446ab576bcfd4af63fd1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:17.237906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:17.238394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:17.238526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:17.257721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:17.258899 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:17.317261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1233/2499] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:17.327517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:17.329007 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:17.386110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371e892-602b-4b90-b2f0-2946eb9dae35 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:17.389773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:17.390372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:17.390652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:17.390929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:17.400052 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:17.401552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:17.411014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1267/2500] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:17.673182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:17.674687 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:17.687334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde3850-ca97-47cb-959b-456da16e1eda None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:17.692218 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:17.692887 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:17.693158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:17.693421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] PATH_INFO: `/v3/projects/07b8380b59e842e386aa3fa5f94d76b1` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:17.694537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b8380b59e842e386aa3fa5f94d76b1)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:17.696646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:17.743676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b8380b59e842e386aa3fa5f94d76b1', 'request_id': 'req-b3b03e4e-36b9-49ed-8415-5c82a460e80b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.749684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b8380b59e842e386aa3fa5f94d76b1', 'request_id': 'req-b3b03e4e-36b9-49ed-8415-5c82a460e80b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.755069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b8380b59e842e386aa3fa5f94d76b1', 'request_id': 'req-b3b03e4e-36b9-49ed-8415-5c82a460e80b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.767744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] The token cache is being invalidate because project 07b8380b59e842e386aa3fa5f94d76b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:17.768067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.768772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.770317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1234/2501] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:17 2022] DELETE /identity/v3/projects/07b8380b59e842e386aa3fa5f94d76b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:17.774499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:17.784646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72296620-92dc-447d-9320-3038a4f99ea5 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:17.804558 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:17.843268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:17.843888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:17.844164 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:17.844461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] PATH_INFO: `/v3/users/86a2b043017c4cc98aa4f73f43fab245` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:17.845573 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a2b043017c4cc98aa4f73f43fab245)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:17.847483 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:17.893078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a2b043017c4cc98aa4f73f43fab245'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.900081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a2b043017c4cc98aa4f73f43fab245'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.900773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a2b043017c4cc98aa4f73f43fab245'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.908540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a2b043017c4cc98aa4f73f43fab245'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.920616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-87f08ba5-080c-41ee-ad9b-ca99ab8af502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a2b043017c4cc98aa4f73f43fab245'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:17.926329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1268/2502] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:17 2022] DELETE /identity/v3/users/86a2b043017c4cc98aa4f73f43fab245 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:18.201062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.202698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:18.217022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03e4e-36b9-49ed-8415-5c82a460e80b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.277268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.277905 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.278167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.279071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] PATH_INFO: `/v3/projects/f53f2ed74a934768a118666099e18bec` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.280196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53f2ed74a934768a118666099e18bec)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.282166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.311829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:18.329292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53f2ed74a934768a118666099e18bec', 'request_id': 'req-3829d169-fb3f-47aa-8b62-f11bb1454fb8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:18.335418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53f2ed74a934768a118666099e18bec', 'request_id': 'req-3829d169-fb3f-47aa-8b62-f11bb1454fb8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:18.340969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53f2ed74a934768a118666099e18bec', 'request_id': 'req-3829d169-fb3f-47aa-8b62-f11bb1454fb8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:18.353566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] The token cache is being invalidate because project f53f2ed74a934768a118666099e18bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:18.353858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:18.354490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-3829d169-fb3f-47aa-8b62-f11bb1454fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:18.355959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1235/2503] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:18 2022] DELETE /identity/v3/projects/f53f2ed74a934768a118666099e18bec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:18.360884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c366c-5421-4edd-bbe2-1f57a54043be None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.361368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c366c-5421-4edd-bbe2-1f57a54043be None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.361473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c366c-5421-4edd-bbe2-1f57a54043be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.380507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-9e5c366c-5421-4edd-bbe2-1f57a54043be None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:18.381703 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9e5c366c-5421-4edd-bbe2-1f57a54043be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:18.441438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1269/2504] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:18.451063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6a40-b40c-4efd-b6c1-159f042621f7 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.451342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6a40-b40c-4efd-b6c1-159f042621f7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.451613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6a40-b40c-4efd-b6c1-159f042621f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.471161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-693e6a40-b40c-4efd-b6c1-159f042621f7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:18.472364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-693e6a40-b40c-4efd-b6c1-159f042621f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:18.480459 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1236/2505] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:18.484685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c366c-5421-4edd-bbe2-1f57a54043be None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.494705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c366c-5421-4edd-bbe2-1f57a54043be None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.499727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.500314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.500627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.500905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.501574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:18.501903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.503699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.518335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1270/2506] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:18.522666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6a40-b40c-4efd-b6c1-159f042621f7 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.532290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6a40-b40c-4efd-b6c1-159f042621f7 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.536981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.537570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.537846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.538114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.538733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.540651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.566966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1237/2507] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:18 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:18.571239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.581892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25956-d678-4502-877a-b63f4883a659 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.607519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:18.641402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.642009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.642290 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.642587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.643220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.645169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.666008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1271/2508] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:18 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:18.670277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.680546 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f3c03-d9d9-4b19-bc4e-5328f4414c60 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.685606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.686191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.686467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.686735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.687650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.689300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.699885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1238/2509] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:18.704103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.713929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2bd3-7bb8-4275-b70a-ed52c6639946 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.718504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae0bf1-95b5-4e63-abb0-536c61d32fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.719082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae0bf1-95b5-4e63-abb0-536c61d32fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.719357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae0bf1-95b5-4e63-abb0-536c61d32fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.719624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae0bf1-95b5-4e63-abb0-536c61d32fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.720249 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae0bf1-95b5-4e63-abb0-536c61d32fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.721890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae0bf1-95b5-4e63-abb0-536c61d32fe7 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.732403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1272/2510] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:18.736244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.746083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5071d-8e6b-4945-9077-f85d252c9c6c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.751216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.751844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.752122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.752421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] PATH_INFO: `/v3/projects/85ed769de28c48a19ef1be5f5615dc01/users/04fd40d2c0d248459cc32d8438d45765/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.772182 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ed769de28c48a19ef1be5f5615dc01, user_id=04fd40d2c0d248459cc32d8438d45765, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.774850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.787857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1239/2511] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:18 2022] PUT /identity/v3/projects/85ed769de28c48a19ef1be5f5615dc01/users/04fd40d2c0d248459cc32d8438d45765/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:18.804705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969988-a5ca-4e5f-b814-2363749a72dc None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.804974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969988-a5ca-4e5f-b814-2363749a72dc None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.805240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969988-a5ca-4e5f-b814-2363749a72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.835955 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-80969988-a5ca-4e5f-b814-2363749a72dc None None] MFA Rules not processed for user `04fd40d2c0d248459cc32d8438d45765`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:18.837211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-80969988-a5ca-4e5f-b814-2363749a72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:18.899939 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1273/2512] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:18.904621 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:18.964743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb5fc-fcb6-4e2f-8f8d-13ac3caa615f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:18.969243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:18.969828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:18.970104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:18.970378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:18.971001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:18.972953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:18.999830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1240/2513] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:18 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:36:19.004021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80969988-a5ca-4e5f-b814-2363749a72dc None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:19.014548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80969988-a5ca-4e5f-b814-2363749a72dc None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:19.069191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:19.069782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.070066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.070337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.070952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:19.072982 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:19.093236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1274/2514] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:19 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:19.097273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:19.108189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9afaa0-2041-47ce-886b-d84411b4aaef admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:19.112885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:19.113480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.113778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.114031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.114668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:19.116272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:19.127201 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1241/2515] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:19.131257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:19.141343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d464-efae-4bb3-93e1-5bf967747be4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:19.145895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:19.146532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.146810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.147083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] PATH_INFO: `/v3/projects/b4e1fa28135043838d84b41ca0c2d4db/users/4bf64740ad4c44388045aa9c51cc6b22/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.161482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e1fa28135043838d84b41ca0c2d4db, user_id=4bf64740ad4c44388045aa9c51cc6b22, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:19.164128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:19.177247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1275/2516] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:19 2022] PUT /identity/v3/projects/b4e1fa28135043838d84b41ca0c2d4db/users/4bf64740ad4c44388045aa9c51cc6b22/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:19.181156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:19.191693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998795e-f086-4784-bbce-a448f33cf85d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:19.211139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:19.250939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f7b9f-bb87-46c4-9f43-465ef88dd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:19.251490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f7b9f-bb87-46c4-9f43-465ef88dd206 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.251767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f7b9f-bb87-46c4-9f43-465ef88dd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.252043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f7b9f-bb87-46c4-9f43-465ef88dd206 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.252711 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f7b9f-bb87-46c4-9f43-465ef88dd206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:19.254307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f7b9f-bb87-46c4-9f43-465ef88dd206 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:19.263803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1242/2517] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:19.268108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:19.273581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:19.280276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccc9f-d20b-463f-a126-504fb11ce681 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:19.285154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:19.285816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.286092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.286385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] PATH_INFO: `/v3/projects/b4e1fa28135043838d84b41ca0c2d4db/users/4bf64740ad4c44388045aa9c51cc6b22/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.288263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e1fa28135043838d84b41ca0c2d4db, user_id=4bf64740ad4c44388045aa9c51cc6b22, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:19.290937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:19.301318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1276/2518] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:19 2022] PUT /identity/v3/projects/b4e1fa28135043838d84b41ca0c2d4db/users/4bf64740ad4c44388045aa9c51cc6b22/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:19.311536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58afed-2e68-4655-bee1-72379e6eb8b4 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.312028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58afed-2e68-4655-bee1-72379e6eb8b4 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.312154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58afed-2e68-4655-bee1-72379e6eb8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.339011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-9c58afed-2e68-4655-bee1-72379e6eb8b4 None None] MFA Rules not processed for user `4bf64740ad4c44388045aa9c51cc6b22`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:19.340214 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9c58afed-2e68-4655-bee1-72379e6eb8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:19.407031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1243/2519] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:19.418624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:19.421058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:19.477500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928a8f3-1f4c-4912-83dc-fdb5bc487c15 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:19.481245 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:19.482425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.482716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.482984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.492410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:19.493874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:19.503313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1277/2520] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:19.579570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58afed-2e68-4655-bee1-72379e6eb8b4 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:19.590422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58afed-2e68-4655-bee1-72379e6eb8b4 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:19.595720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8498-0c79-47ff-9572-62e05b152aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:19.596717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8498-0c79-47ff-9572-62e05b152aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:19.597004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8498-0c79-47ff-9572-62e05b152aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:19.597270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8498-0c79-47ff-9572-62e05b152aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:19.653275 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d8498-0c79-47ff-9572-62e05b152aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:19.655227 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d8498-0c79-47ff-9572-62e05b152aa0 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:19.663878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1244/2521] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:26.391268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:26.451524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bff140-4a22-488e-a2a4-0b987a64c970 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:26.456226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:26.456893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:26.457174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:26.457445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] PATH_INFO: `/v3/users/04fd40d2c0d248459cc32d8438d45765` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:26.458577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fd40d2c0d248459cc32d8438d45765)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:26.460525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:26.505593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fd40d2c0d248459cc32d8438d45765'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:26.512616 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fd40d2c0d248459cc32d8438d45765'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:26.513832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fd40d2c0d248459cc32d8438d45765'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:26.520410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fd40d2c0d248459cc32d8438d45765'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:26.533919 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fd40d2c0d248459cc32d8438d45765'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:26.539995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1278/2522] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:26 2022] DELETE /identity/v3/users/04fd40d2c0d248459cc32d8438d45765 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:26.544470 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780df32-65d8-486a-9152-eaf701622069 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:26.544969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780df32-65d8-486a-9152-eaf701622069 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:26.545069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780df32-65d8-486a-9152-eaf701622069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:26.564716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-5780df32-65d8-486a-9152-eaf701622069 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:26.565932 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5780df32-65d8-486a-9152-eaf701622069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:26.605759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:26.624716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1245/2523] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:26.634406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:26.635804 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:26.649781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:26.694922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966cfd3-44f7-47ff-ba47-317daff11052 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:26.698501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:26.699090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:26.699364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:26.699632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:26.708947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:26.710390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:26.719519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1279/2524] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:26.986092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780df32-65d8-486a-9152-eaf701622069 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:26.987612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5780df32-65d8-486a-9152-eaf701622069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:27.005169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780df32-65d8-486a-9152-eaf701622069 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:27.010086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:27.010789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.010979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.011249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] PATH_INFO: `/v3/projects/85ed769de28c48a19ef1be5f5615dc01` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.012593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ed769de28c48a19ef1be5f5615dc01)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:27.014836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:27.059910 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ed769de28c48a19ef1be5f5615dc01', 'request_id': 'req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.065942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ed769de28c48a19ef1be5f5615dc01', 'request_id': 'req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.071320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ed769de28c48a19ef1be5f5615dc01', 'request_id': 'req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.083708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] The token cache is being invalidate because project 85ed769de28c48a19ef1be5f5615dc01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:27.083997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.084690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.086160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1246/2525] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:26 2022] DELETE /identity/v3/projects/85ed769de28c48a19ef1be5f5615dc01 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:27.090135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:27.100783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e477-168b-449f-9057-ecd36c63b3cb service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:27.156163 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:27.156812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.157090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.157359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] PATH_INFO: `/v3/users/4bf64740ad4c44388045aa9c51cc6b22` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.158456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf64740ad4c44388045aa9c51cc6b22)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:27.160409 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:27.205417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf64740ad4c44388045aa9c51cc6b22'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.212254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf64740ad4c44388045aa9c51cc6b22'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.212937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf64740ad4c44388045aa9c51cc6b22'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.220297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf64740ad4c44388045aa9c51cc6b22'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.233023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f5532ff0-7a89-40f6-be29-782c6c6240b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf64740ad4c44388045aa9c51cc6b22'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.238924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1280/2526] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:27 2022] DELETE /identity/v3/users/4bf64740ad4c44388045aa9c51cc6b22 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:27.502695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:27.504103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:27.517404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8e3c6-a4a8-4fb6-a792-548a4c9c65ba admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:27.576804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:27.577434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.577689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.577954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] PATH_INFO: `/v3/projects/b4e1fa28135043838d84b41ca0c2d4db` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.579044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e1fa28135043838d84b41ca0c2d4db)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:27.580977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:27.626340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e1fa28135043838d84b41ca0c2d4db', 'request_id': 'req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.632332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e1fa28135043838d84b41ca0c2d4db', 'request_id': 'req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.637746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e1fa28135043838d84b41ca0c2d4db', 'request_id': 'req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.645527 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:27.650975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] The token cache is being invalidate because project b4e1fa28135043838d84b41ca0c2d4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:27.651456 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.652160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c6b6b1d9-800b-40ea-9469-702a2fe0e2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:27.654728 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1247/2527] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:27 2022] DELETE /identity/v3/projects/b4e1fa28135043838d84b41ca0c2d4db => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:27.659545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196951f6-ada7-48f1-b23a-bf4b50c247dd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.660004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196951f6-ada7-48f1-b23a-bf4b50c247dd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.660104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196951f6-ada7-48f1-b23a-bf4b50c247dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.679608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-196951f6-ada7-48f1-b23a-bf4b50c247dd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:27.680852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-196951f6-ada7-48f1-b23a-bf4b50c247dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:27.710627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:27.742119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1281/2528] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:27.750931 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f4bfa-fba7-4471-899e-5db49319eba2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.751184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f4bfa-fba7-4471-899e-5db49319eba2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.751459 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f4bfa-fba7-4471-899e-5db49319eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.771312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-208f4bfa-fba7-4471-899e-5db49319eba2 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:27.772668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-208f4bfa-fba7-4471-899e-5db49319eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:27.780533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1248/2529] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:27.784770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196951f6-ada7-48f1-b23a-bf4b50c247dd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:27.795073 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196951f6-ada7-48f1-b23a-bf4b50c247dd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:27.799757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:27.800447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.800753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.801080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.801810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:27.802209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:27.804060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:27.817083 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1282/2530] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:27.821408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f4bfa-fba7-4471-899e-5db49319eba2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:27.831167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f4bfa-fba7-4471-899e-5db49319eba2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:27.836010 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:27.836662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.836944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.837215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.837844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:27.839737 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:27.870636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1249/2531] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:27 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:27.871902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:27.882583 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15671a74-1b8f-4087-b085-26c96063b1dd admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:27.940376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:27.941006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.941307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.941600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.942214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:27.944117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:27.965103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1283/2532] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:27 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:27.969427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:27.979858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cf8e-5a4a-48b1-8e8a-e8aa03154b4e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:27.985080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:27.985669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:27.985943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:27.986237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:27.986876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:27.988497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:27.998783 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1250/2533] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:28.002845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.013186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be1703-90b4-4c3d-a4c7-56948d5c7c7a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.017738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd80f-e43b-49b9-b85b-1d27ca2d9571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.018320 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd80f-e43b-49b9-b85b-1d27ca2d9571 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.018596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd80f-e43b-49b9-b85b-1d27ca2d9571 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.018864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd80f-e43b-49b9-b85b-1d27ca2d9571 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.019502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd80f-e43b-49b9-b85b-1d27ca2d9571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.021134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd80f-e43b-49b9-b85b-1d27ca2d9571 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.031395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1284/2534] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:28.035367 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.045641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f8491-7553-491e-a4d4-6e546425b084 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.050223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.050852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.051132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.051406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] PATH_INFO: `/v3/projects/84cfbc7e9760483ea9b2fd5f0466a630/users/6576f2020b594a0eb00d9401280183e2/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.066231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84cfbc7e9760483ea9b2fd5f0466a630, user_id=6576f2020b594a0eb00d9401280183e2, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.068920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.081402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1251/2535] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:28 2022] PUT /identity/v3/projects/84cfbc7e9760483ea9b2fd5f0466a630/users/6576f2020b594a0eb00d9401280183e2/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:28.091469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0d3a-4abf-4ba8-8586-79112dd9bc70 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.091775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0d3a-4abf-4ba8-8586-79112dd9bc70 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.092085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db0d3a-4abf-4ba8-8586-79112dd9bc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.128713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-91db0d3a-4abf-4ba8-8586-79112dd9bc70 None None] MFA Rules not processed for user `6576f2020b594a0eb00d9401280183e2`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:28.129929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-91db0d3a-4abf-4ba8-8586-79112dd9bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:28.194923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1285/2536] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:28.199506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.264100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28502-3ecf-48a4-af3c-3f3ac373806a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.268700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.269316 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.269610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.269901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.270515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.272420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.298749 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1252/2537] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:28 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:28.302913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0d3a-4abf-4ba8-8586-79112dd9bc70 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.313653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db0d3a-4abf-4ba8-8586-79112dd9bc70 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.338603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:28.370003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.370602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.370880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.371150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.371771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.373738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.395681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1286/2538] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:28 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:28.397929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.409081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2468a64-46e6-48a5-ad5b-cce688fac1c5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.413976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.414511 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.414785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.415052 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.415680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.417295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.428220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1253/2539] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:28.432272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.442309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3019-48e3-4836-9f4f-5d7cec4423b4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.446850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.447501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.447768 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.448040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] PATH_INFO: `/v3/projects/1eb5a8d7d95f421a823a098606d2abdf/users/52886053581b40098585d3205e449154/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.462492 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb5a8d7d95f421a823a098606d2abdf, user_id=52886053581b40098585d3205e449154, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.465151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.478503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1287/2540] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:28 2022] PUT /identity/v3/projects/1eb5a8d7d95f421a823a098606d2abdf/users/52886053581b40098585d3205e449154/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:28.483034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.492795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5b970-1bcf-4c4f-8a16-0c5314061c26 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.548979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f19f2-49fe-4c1d-8423-a89a306ef5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.549579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f19f2-49fe-4c1d-8423-a89a306ef5ed admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.549859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f19f2-49fe-4c1d-8423-a89a306ef5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.550129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f19f2-49fe-4c1d-8423-a89a306ef5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.550755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f19f2-49fe-4c1d-8423-a89a306ef5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.552351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f19f2-49fe-4c1d-8423-a89a306ef5ed admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.561830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1254/2541] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:28.565932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.576556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84628f-6819-477b-b179-53ce4e4d3b86 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.581139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.581776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.582051 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.582319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] PATH_INFO: `/v3/projects/1eb5a8d7d95f421a823a098606d2abdf/users/52886053581b40098585d3205e449154/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.584218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb5a8d7d95f421a823a098606d2abdf, user_id=52886053581b40098585d3205e449154, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.586859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.597257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1288/2542] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:28 2022] PUT /identity/v3/projects/1eb5a8d7d95f421a823a098606d2abdf/users/52886053581b40098585d3205e449154/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:28.608432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd41b8-aa5c-40c7-afe7-c15b2952ea05 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.608921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd41b8-aa5c-40c7-afe7-c15b2952ea05 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.609026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd41b8-aa5c-40c7-afe7-c15b2952ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.617134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:28.639530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6ffd41b8-aa5c-40c7-afe7-c15b2952ea05 None None] MFA Rules not processed for user `52886053581b40098585d3205e449154`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:28.640779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6ffd41b8-aa5c-40c7-afe7-c15b2952ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:28.707025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1255/2543] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:28.719123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:28.720845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:28.777046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c3553-7858-4cdb-8981-76b4bdcaa8f7 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:28.781379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f73b-0154-400d-bb64-b68716e2a8da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:28.781915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f73b-0154-400d-bb64-b68716e2a8da service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:28.782217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f73b-0154-400d-bb64-b68716e2a8da service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:28.782487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f73b-0154-400d-bb64-b68716e2a8da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:28.791401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76f73b-0154-400d-bb64-b68716e2a8da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:28.792886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76f73b-0154-400d-bb64-b68716e2a8da service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:28.802745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1289/2544] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:29.175011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd41b8-aa5c-40c7-afe7-c15b2952ea05 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:29.236580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd41b8-aa5c-40c7-afe7-c15b2952ea05 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:29.241088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:29.241707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:29.241982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:29.242247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] PATH_INFO: `/v3/users/6576f2020b594a0eb00d9401280183e2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:29.243358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6576f2020b594a0eb00d9401280183e2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:29.245295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:29.289637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6576f2020b594a0eb00d9401280183e2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.297139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6576f2020b594a0eb00d9401280183e2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.304084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6576f2020b594a0eb00d9401280183e2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.304693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6576f2020b594a0eb00d9401280183e2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.305289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6576f2020b594a0eb00d9401280183e2'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.322829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1256/2545] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:29 2022] DELETE /identity/v3/users/6576f2020b594a0eb00d9401280183e2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:29.327260 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:29.327545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:29.327816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:29.346025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:29.347204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:29.403185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1290/2546] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:29.412753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:29.414159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:29.425654 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:29.472833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1dc3c-acdf-4667-881c-1b569b42c06b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:29.476708 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:29.477299 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:29.477578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:29.477849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:29.487081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:29.488537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:29.498412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1257/2547] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:29.782830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:29.784519 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:29.797554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ddf0-7f69-4512-88b5-df846033baee None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:29.814295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:29.814875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:29.815157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:29.815432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] PATH_INFO: `/v3/projects/84cfbc7e9760483ea9b2fd5f0466a630` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:29.816745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84cfbc7e9760483ea9b2fd5f0466a630)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:29.818733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:29.843641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:29.880578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84cfbc7e9760483ea9b2fd5f0466a630', 'request_id': 'req-2c78e7a6-6773-44dd-84bf-451155617850'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.883041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84cfbc7e9760483ea9b2fd5f0466a630', 'request_id': 'req-2c78e7a6-6773-44dd-84bf-451155617850'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.892219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84cfbc7e9760483ea9b2fd5f0466a630', 'request_id': 'req-2c78e7a6-6773-44dd-84bf-451155617850'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.904577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] The token cache is being invalidate because project 84cfbc7e9760483ea9b2fd5f0466a630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:29.904867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.905498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:29.906985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1291/2548] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:29 2022] DELETE /identity/v3/projects/84cfbc7e9760483ea9b2fd5f0466a630 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:29.911283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:29.921732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ce055-b657-4417-ba9a-358e59456a52 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:29.987591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:29.988333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:29.988713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:29.988982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] PATH_INFO: `/v3/users/52886053581b40098585d3205e449154` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:29.990126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52886053581b40098585d3205e449154)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:29.992059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.040690 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52886053581b40098585d3205e449154'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.049449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52886053581b40098585d3205e449154'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.056786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52886053581b40098585d3205e449154'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.057432 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52886053581b40098585d3205e449154'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.058105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-37410c25-a953-4931-aeae-7d7aeda1ea68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52886053581b40098585d3205e449154'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.077449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1258/2549] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:29 2022] DELETE /identity/v3/users/52886053581b40098585d3205e449154 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:30.361056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:30.362497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:30.377316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e7a6-6773-44dd-84bf-451155617850 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:30.436820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:30.437451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.437732 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.438008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] PATH_INFO: `/v3/projects/1eb5a8d7d95f421a823a098606d2abdf` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.439117 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb5a8d7d95f421a823a098606d2abdf)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:30.441068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.487792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb5a8d7d95f421a823a098606d2abdf', 'request_id': 'req-e60bbf9a-5667-418d-aa6a-ab4291f284d6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.493820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb5a8d7d95f421a823a098606d2abdf', 'request_id': 'req-e60bbf9a-5667-418d-aa6a-ab4291f284d6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.501353 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb5a8d7d95f421a823a098606d2abdf', 'request_id': 'req-e60bbf9a-5667-418d-aa6a-ab4291f284d6'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.515296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] The token cache is being invalidate because project 1eb5a8d7d95f421a823a098606d2abdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:30.515584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.516273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e60bbf9a-5667-418d-aa6a-ab4291f284d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:30.518013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1292/2550] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:30 2022] DELETE /identity/v3/projects/1eb5a8d7d95f421a823a098606d2abdf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:30.522875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40eda0-7c9f-47de-b752-f4bcae21ecba None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.523192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40eda0-7c9f-47de-b752-f4bcae21ecba None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.523426 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40eda0-7c9f-47de-b752-f4bcae21ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.543555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1e40eda0-7c9f-47de-b752-f4bcae21ecba None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:30.545338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1e40eda0-7c9f-47de-b752-f4bcae21ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:30.570673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:30.605280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1259/2551] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:30.613552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b8c32-f880-4f81-a775-efb877145dd3 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.613836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b8c32-f880-4f81-a775-efb877145dd3 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.614132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b8c32-f880-4f81-a775-efb877145dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.633720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-0f6b8c32-f880-4f81-a775-efb877145dd3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:30.634917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0f6b8c32-f880-4f81-a775-efb877145dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:30.642816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1293/2552] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:30.647167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40eda0-7c9f-47de-b752-f4bcae21ecba None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:30.657534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40eda0-7c9f-47de-b752-f4bcae21ecba None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:30.662240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:30.662830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.663128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.663394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.664031 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:30.664327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:30.665941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.677964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1260/2553] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:30.682162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b8c32-f880-4f81-a775-efb877145dd3 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:30.691440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b8c32-f880-4f81-a775-efb877145dd3 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:30.696050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:30.696662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.696941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.697210 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.697837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:30.699724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.726517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1294/2554] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:30 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:30.730649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:30.740486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cf147-23e3-4a0d-9bb9-3e4efa573399 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:30.795354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:30.795936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.796210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.796508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.797129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:30.799027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.819307 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1261/2555] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:30 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:30.823352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:30.834190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cfceb-854e-43fe-a48d-16315f414e87 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:30.838877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:30.839473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.839738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.840003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.840672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:30.842907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.845006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:30.854234 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1295/2556] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:30.857885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:30.867718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fcbed-cbc8-4698-ab0a-e46ff2784ab9 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:30.872253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6c648-348d-4b1e-8a25-6cc5487ca4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:30.872883 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c648-348d-4b1e-8a25-6cc5487ca4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.873160 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c648-348d-4b1e-8a25-6cc5487ca4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.873424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c648-348d-4b1e-8a25-6cc5487ca4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.874047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6c648-348d-4b1e-8a25-6cc5487ca4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:30.875631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6c648-348d-4b1e-8a25-6cc5487ca4b0 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.885888 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1262/2557] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:30.890468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:30.900802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35613a2-27f0-4aac-bade-beeea5bebd26 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:30.906197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:30.906954 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.907251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.907523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] PATH_INFO: `/v3/projects/70060944a8d74fe68ad0409c67b85266/users/7a027304f3154fa1bcb060ee54ad9bcd/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.922131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70060944a8d74fe68ad0409c67b85266, user_id=7a027304f3154fa1bcb060ee54ad9bcd, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:30.924809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:30.937386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1296/2558] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:30 2022] PUT /identity/v3/projects/70060944a8d74fe68ad0409c67b85266/users/7a027304f3154fa1bcb060ee54ad9bcd/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:30.947648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd820-a351-451c-841c-cefa1536b74f None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:30.948122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd820-a351-451c-841c-cefa1536b74f None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:30.948250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd820-a351-451c-841c-cefa1536b74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:30.976372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-b5cfd820-a351-451c-841c-cefa1536b74f None None] MFA Rules not processed for user `7a027304f3154fa1bcb060ee54ad9bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:30.977593 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b5cfd820-a351-451c-841c-cefa1536b74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:31.040070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1263/2559] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:31.044787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:31.106429 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e2f2-3989-431e-a722-8aa4f247e87d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:31.111180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:31.111716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.112030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.112351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.113072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:31.115104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:31.140996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1297/2560] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:31 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:31.145129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd820-a351-451c-841c-cefa1536b74f None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:31.156154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd820-a351-451c-841c-cefa1536b74f None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:31.181006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:31.216239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:31.216861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.217138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.217409 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.218056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:31.219975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:31.241458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1264/2561] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:31 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:31.245414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:31.257608 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6765-192e-428a-a424-5cec98c9f022 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:31.262330 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:31.263641 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.263994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.264335 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.265139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:31.266818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:31.277983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1298/2562] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:31.282294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:31.292537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7c83c-fa5b-4af8-a049-d872cdb7e7c7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:31.297983 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:31.298638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.298916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.299189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] PATH_INFO: `/v3/projects/256c0a16b0534439b4f3a706b5d59416/users/e2e93945c543445eb31c3de2576d7e57/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.315485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256c0a16b0534439b4f3a706b5d59416, user_id=e2e93945c543445eb31c3de2576d7e57, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:31.318165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:31.332249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1265/2563] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:31 2022] PUT /identity/v3/projects/256c0a16b0534439b4f3a706b5d59416/users/e2e93945c543445eb31c3de2576d7e57/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:31.336688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:31.348286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0619f-4131-4423-91d8-2c068c5e1fc6 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:31.419712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11421a-5d80-4ddd-8ea7-e33de77db7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:31.425158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11421a-5d80-4ddd-8ea7-e33de77db7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.425591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11421a-5d80-4ddd-8ea7-e33de77db7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.426012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11421a-5d80-4ddd-8ea7-e33de77db7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.426792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11421a-5d80-4ddd-8ea7-e33de77db7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:31.428859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11421a-5d80-4ddd-8ea7-e33de77db7a2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:31.440779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1299/2564] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:31.444750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:31.455587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f341e98-d841-42e8-b033-653cfbe45b62 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:31.460150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:31.460824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.461102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.461373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] PATH_INFO: `/v3/projects/256c0a16b0534439b4f3a706b5d59416/users/e2e93945c543445eb31c3de2576d7e57/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.463287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256c0a16b0534439b4f3a706b5d59416, user_id=e2e93945c543445eb31c3de2576d7e57, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:31.465925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:31.476540 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1266/2565] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:31 2022] PUT /identity/v3/projects/256c0a16b0534439b4f3a706b5d59416/users/e2e93945c543445eb31c3de2576d7e57/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:31.487629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e6651-62b4-449c-a404-b0ad01863434 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.487917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e6651-62b4-449c-a404-b0ad01863434 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.488198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e6651-62b4-449c-a404-b0ad01863434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.517271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a87e6651-62b4-449c-a404-b0ad01863434 None None] MFA Rules not processed for user `e2e93945c543445eb31c3de2576d7e57`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:31.518556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a87e6651-62b4-449c-a404-b0ad01863434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:31.557699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:31.601953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1300/2566] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:31.614287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:31.616040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:31.678336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368a7dd-d8fb-4728-a7d2-6ba67890fd40 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:31.681866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fccea6-3cf2-45a2-8350-0e022be409ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:31.682462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccea6-3cf2-45a2-8350-0e022be409ee service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:31.682736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccea6-3cf2-45a2-8350-0e022be409ee service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:31.683005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccea6-3cf2-45a2-8350-0e022be409ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:31.692785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fccea6-3cf2-45a2-8350-0e022be409ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:31.694216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fccea6-3cf2-45a2-8350-0e022be409ee service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:31.704696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1267/2567] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:32.129272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e6651-62b4-449c-a404-b0ad01863434 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:32.196095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e6651-62b4-449c-a404-b0ad01863434 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:32.200587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:32.201212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:32.201493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:32.201764 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] PATH_INFO: `/v3/users/7a027304f3154fa1bcb060ee54ad9bcd` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:32.202879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a027304f3154fa1bcb060ee54ad9bcd)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:32.204839 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:32.255120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a027304f3154fa1bcb060ee54ad9bcd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:32.262880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a027304f3154fa1bcb060ee54ad9bcd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:32.263713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a027304f3154fa1bcb060ee54ad9bcd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:32.271203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a027304f3154fa1bcb060ee54ad9bcd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:32.288011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a027304f3154fa1bcb060ee54ad9bcd'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:32.294817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1301/2568] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:32 2022] DELETE /identity/v3/users/7a027304f3154fa1bcb060ee54ad9bcd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:32.299944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:32.300516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:32.300516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:32.320368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:32.321812 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:32.396013 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1268/2569] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:32.410316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:32.413022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:32.522751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:32.527414 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e1ff2-25a0-43fd-9ab6-ea09abe193ef admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:32.534512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:32.536018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:32.536526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:32.540802 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:32.552813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:32.554775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:32.566907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1302/2570] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:33.105448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:33.107111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:33.129246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb35f-01ae-4da5-8c10-c15a229c3423 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:33.134374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:33.135044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:33.135322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:33.135588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] PATH_INFO: `/v3/projects/70060944a8d74fe68ad0409c67b85266` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:33.136746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70060944a8d74fe68ad0409c67b85266)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:33.139212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:33.157512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:33.188125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70060944a8d74fe68ad0409c67b85266', 'request_id': 'req-14c07adf-1a0b-4087-9d5f-d1fa021251a3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.195029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70060944a8d74fe68ad0409c67b85266', 'request_id': 'req-14c07adf-1a0b-4087-9d5f-d1fa021251a3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.201101 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70060944a8d74fe68ad0409c67b85266', 'request_id': 'req-14c07adf-1a0b-4087-9d5f-d1fa021251a3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.213594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] The token cache is being invalidate because project 70060944a8d74fe68ad0409c67b85266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:33.213876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.214498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.215998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1269/2571] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:33 2022] DELETE /identity/v3/projects/70060944a8d74fe68ad0409c67b85266 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:33.220741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:33.230843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d0f8d-c0a3-42fc-aa0b-13eb06e31e68 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:33.288196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:33.288864 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:33.289142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:33.289413 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] PATH_INFO: `/v3/users/e2e93945c543445eb31c3de2576d7e57` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:33.290542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e93945c543445eb31c3de2576d7e57)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:33.292538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:33.342027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e93945c543445eb31c3de2576d7e57'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.350370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e93945c543445eb31c3de2576d7e57'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.350632 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e93945c543445eb31c3de2576d7e57'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.359403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e93945c543445eb31c3de2576d7e57'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.371898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4cefea7b-3884-4a39-bc73-eb63f70bf4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e93945c543445eb31c3de2576d7e57'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.377866 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1303/2572] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:33 2022] DELETE /identity/v3/users/e2e93945c543445eb31c3de2576d7e57 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:33.646836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:33.648319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:33.672715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c07adf-1a0b-4087-9d5f-d1fa021251a3 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:33.731692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:33.732682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:33.732682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:33.732682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] PATH_INFO: `/v3/projects/256c0a16b0534439b4f3a706b5d59416` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:33.734474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256c0a16b0534439b4f3a706b5d59416)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:33.736662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:33.784288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256c0a16b0534439b4f3a706b5d59416', 'request_id': 'req-f6fc11c3-2643-4cfd-98fc-42d741516c17'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.790360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256c0a16b0534439b4f3a706b5d59416', 'request_id': 'req-f6fc11c3-2643-4cfd-98fc-42d741516c17'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.796682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256c0a16b0534439b4f3a706b5d59416', 'request_id': 'req-f6fc11c3-2643-4cfd-98fc-42d741516c17'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.810982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] The token cache is being invalidate because project 256c0a16b0534439b4f3a706b5d59416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:33.811317 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.812060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-f6fc11c3-2643-4cfd-98fc-42d741516c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:33.813633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1270/2573] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:33 2022] DELETE /identity/v3/projects/256c0a16b0534439b4f3a706b5d59416 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:33.818956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba9eb-96a7-4e8b-9c16-d91deda4b816 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:33.819276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba9eb-96a7-4e8b-9c16-d91deda4b816 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:33.819710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba9eb-96a7-4e8b-9c16-d91deda4b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:33.846847 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-870ba9eb-96a7-4e8b-9c16-d91deda4b816 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:33.849808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-870ba9eb-96a7-4e8b-9c16-d91deda4b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:33.924423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1304/2574] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:33.928722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c38c-b5e4-49bb-b7bc-2f4a0a446554 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:33.929216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c38c-b5e4-49bb-b7bc-2f4a0a446554 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:33.929556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c38c-b5e4-49bb-b7bc-2f4a0a446554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:33.950777 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-3f31c38c-b5e4-49bb-b7bc-2f4a0a446554 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:33.952086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3f31c38c-b5e4-49bb-b7bc-2f4a0a446554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:33.960200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1271/2575] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:33.964464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba9eb-96a7-4e8b-9c16-d91deda4b816 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:33.974590 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba9eb-96a7-4e8b-9c16-d91deda4b816 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:33.979674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:33.980276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:33.980582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:33.980857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:33.981534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:33.982363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:33.983971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:33.990993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:33.998801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1305/2576] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:34.003157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c38c-b5e4-49bb-b7bc-2f4a0a446554 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.012464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c38c-b5e4-49bb-b7bc-2f4a0a446554 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.017102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.017692 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.017969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.018239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.018861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.020828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.049126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1272/2577] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:34 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:36:34.053256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.063681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcec71-67b2-416f-b91b-94f0be516a96 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.120931 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.121692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.121974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.122302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.122945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.125050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.151411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1306/2578] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:34 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:34.152774 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.163431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e09eee-f56b-4f17-a8e8-aa51cfef4d54 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.171498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.172301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.172617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.172889 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.173534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.175503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.176942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:34.191163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1273/2579] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:34.192275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.202528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e704fd-01a0-48a6-82fe-573f7938c1b4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.207362 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f8422-e695-4d11-9aae-c8e194a46bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.207998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8422-e695-4d11-9aae-c8e194a46bbd admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.208304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8422-e695-4d11-9aae-c8e194a46bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.208605 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8422-e695-4d11-9aae-c8e194a46bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.209248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8422-e695-4d11-9aae-c8e194a46bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.211133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f8422-e695-4d11-9aae-c8e194a46bbd admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.223294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1307/2580] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:34.227929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.238992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fe1a-9ed4-4724-ac51-bb4147532753 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.246107 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.247205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.247693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.248174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] PATH_INFO: `/v3/projects/fae6369891034f46bc6d111ac2d7a8f3/users/811da46fe60f48ab8ddfe429cc32587d/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.268949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae6369891034f46bc6d111ac2d7a8f3, user_id=811da46fe60f48ab8ddfe429cc32587d, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.271597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.286373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1274/2581] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:34 2022] PUT /identity/v3/projects/fae6369891034f46bc6d111ac2d7a8f3/users/811da46fe60f48ab8ddfe429cc32587d/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:34.298283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d75f0-23df-4f3d-b7ed-ff2fe7be3634 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.298801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d75f0-23df-4f3d-b7ed-ff2fe7be3634 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.299078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d75f0-23df-4f3d-b7ed-ff2fe7be3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.336317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6d9d75f0-23df-4f3d-b7ed-ff2fe7be3634 None None] MFA Rules not processed for user `811da46fe60f48ab8ddfe429cc32587d`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:34.337677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6d9d75f0-23df-4f3d-b7ed-ff2fe7be3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:34.407988 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1308/2582] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:34.412439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.478680 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06522e02-f76d-4f78-a7f4-2cf1a51da1b6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.484252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.484923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.485209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.485481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.486165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.488159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.516011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1275/2583] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:34 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:34.519967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d75f0-23df-4f3d-b7ed-ff2fe7be3634 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.531827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d75f0-23df-4f3d-b7ed-ff2fe7be3634 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.596739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.597094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.597382 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.597655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.598580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.600646 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.613434 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:34.624521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1309/2584] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:34 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:34.628771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.639124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecae63-3194-4280-86fb-4e16cebf879b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.643770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.644361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.644679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.644951 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.645587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.647239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.657826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1276/2585] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:34.661841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.672228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc3e1b-1f2e-48f7-9a10-a0d1c7c258e9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.676796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.677425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.677699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.677970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] PATH_INFO: `/v3/projects/536c0269f4314a1489c411d3cf49b749/users/f24f8625d40a439ead36415078e58c52/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.693399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c0269f4314a1489c411d3cf49b749, user_id=f24f8625d40a439ead36415078e58c52, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.696080 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.709102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1310/2586] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:34 2022] PUT /identity/v3/projects/536c0269f4314a1489c411d3cf49b749/users/f24f8625d40a439ead36415078e58c52/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:34.713033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.722976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff1e5-6a2f-49cf-b95e-172bad72bf89 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.778304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505eb28-ccab-4f90-b43a-cf3c185da215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.778841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505eb28-ccab-4f90-b43a-cf3c185da215 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.779116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505eb28-ccab-4f90-b43a-cf3c185da215 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.779385 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505eb28-ccab-4f90-b43a-cf3c185da215 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.780008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505eb28-ccab-4f90-b43a-cf3c185da215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.781642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505eb28-ccab-4f90-b43a-cf3c185da215 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.791104 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1277/2587] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:34.795685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.805794 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03501e48-38c5-4c62-9062-32fe5b464f7a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:34.810884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:34.811522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.811796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.812065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] PATH_INFO: `/v3/projects/536c0269f4314a1489c411d3cf49b749/users/f24f8625d40a439ead36415078e58c52/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.813994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c0269f4314a1489c411d3cf49b749, user_id=f24f8625d40a439ead36415078e58c52, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:34.816627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:34.826951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1311/2588] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:34 2022] PUT /identity/v3/projects/536c0269f4314a1489c411d3cf49b749/users/f24f8625d40a439ead36415078e58c52/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:34.836645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5495ec-352b-4d30-a079-45f1be1d5f62 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:34.836933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5495ec-352b-4d30-a079-45f1be1d5f62 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:34.837212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5495ec-352b-4d30-a079-45f1be1d5f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:34.864921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-8f5495ec-352b-4d30-a079-45f1be1d5f62 None None] MFA Rules not processed for user `f24f8625d40a439ead36415078e58c52`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:34.866145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-8f5495ec-352b-4d30-a079-45f1be1d5f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:34.896110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:34.935346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1278/2589] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:34.947654 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:34.949368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:35.007000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf62abb-ff77-45bd-97a6-1dfd00ab56a6 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:35.010639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:35.011232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:35.011507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:35.011773 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:35.021326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:35.022747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:35.031983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1312/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:35.332187 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5495ec-352b-4d30-a079-45f1be1d5f62 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:35.341472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5495ec-352b-4d30-a079-45f1be1d5f62 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:35.346238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f24f8625d40a439ead36415078e58c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '536c0269f4314a1489c411d3cf49b749', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:35.346863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:35.347144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:35.347414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:35.348056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:35.348644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:35.350243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:35.361929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1279/2591] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:35.365709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:35.375370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c1ac-feed-46ec-8621-cc68fdcc8b43 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:35.379887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f24f8625d40a439ead36415078e58c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '536c0269f4314a1489c411d3cf49b749', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:35.380500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:35.380782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:35.381079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:35.381735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:35.383609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:35.411169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1313/2592] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:35 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:35.415072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:35.425547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fd80b-21fc-4d00-8a2d-78449044b4f6 tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:35.482042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f24f8625d40a439ead36415078e58c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '536c0269f4314a1489c411d3cf49b749', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:35.482668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:35.482941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:35.483322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:35.483969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:35.484274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:35.485967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:35.501741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1280/2593] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:35.546010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:35.556358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4e467-4aff-42cb-97c7-2ae1386dd17e tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:35.565431 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f24f8625d40a439ead36415078e58c52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '536c0269f4314a1489c411d3cf49b749', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:35.566068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:35.566351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:35.566624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] PATH_INFO: `/v3/projects/857ebeee6b814268969704a2fb5db558` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:35.567756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorizing `identity:delete_project(project_id=857ebeee6b814268969704a2fb5db558)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:35.569747 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:35.621299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857ebeee6b814268969704a2fb5db558', 'request_id': 'req-4a67e5f6-42a7-4910-9bac-30139d20bc9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:35.628168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857ebeee6b814268969704a2fb5db558', 'request_id': 'req-4a67e5f6-42a7-4910-9bac-30139d20bc9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:35.636496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857ebeee6b814268969704a2fb5db558', 'request_id': 'req-4a67e5f6-42a7-4910-9bac-30139d20bc9a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:35.649454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] The token cache is being invalidate because project 857ebeee6b814268969704a2fb5db558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:35.649767 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:35.650416 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-4a67e5f6-42a7-4910-9bac-30139d20bc9a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:35.651958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1314/2594] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:35 2022] DELETE /identity/v3/projects/857ebeee6b814268969704a2fb5db558 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:35.837237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:35.839021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:35.901911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af45166-3574-4d12-a9d3-9d81c179557a tempest-VolumeQuotaClassesTest-1347791680 tempest-VolumeQuotaClassesTest-1347791680-project-admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:35.951041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:35.958213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:35.958835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:35.959110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:35.959381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] PATH_INFO: `/v3/users/811da46fe60f48ab8ddfe429cc32587d` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:35.960538 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=811da46fe60f48ab8ddfe429cc32587d)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:35.962464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:36.008064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811da46fe60f48ab8ddfe429cc32587d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.015668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811da46fe60f48ab8ddfe429cc32587d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.022611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811da46fe60f48ab8ddfe429cc32587d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.023215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811da46fe60f48ab8ddfe429cc32587d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.023802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811da46fe60f48ab8ddfe429cc32587d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.040204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1281/2595] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:35 2022] DELETE /identity/v3/users/811da46fe60f48ab8ddfe429cc32587d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:36.045211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:36.045585 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:36.045865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:36.064554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:36.065763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:36.082406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:36.125859 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1315/2596] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:36.135502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:36.136952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:36.194017 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12efe39-3805-4b6f-800b-d4715a12fdbd admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:36.197568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:36.198159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:36.198433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:36.198698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:36.207442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:36.208902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:36.218067 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1282/2597] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:36.474233 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:36.475693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:36.490305 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea87614-df2e-41fa-841a-0b0b5ab486dd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:36.495633 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:36.496324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:36.496596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:36.496870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] PATH_INFO: `/v3/projects/fae6369891034f46bc6d111ac2d7a8f3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:36.498003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae6369891034f46bc6d111ac2d7a8f3)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:36.499929 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:36.548622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae6369891034f46bc6d111ac2d7a8f3', 'request_id': 'req-a16d367f-43fc-4b32-8451-1bfdeb20182a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.554629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae6369891034f46bc6d111ac2d7a8f3', 'request_id': 'req-a16d367f-43fc-4b32-8451-1bfdeb20182a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.561869 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae6369891034f46bc6d111ac2d7a8f3', 'request_id': 'req-a16d367f-43fc-4b32-8451-1bfdeb20182a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.572039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] The token cache is being invalidate because project fae6369891034f46bc6d111ac2d7a8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:36.572323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.572965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.574441 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1316/2598] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:36 2022] DELETE /identity/v3/projects/fae6369891034f46bc6d111ac2d7a8f3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:36.578575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:36.588264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77fa1-4f89-4b93-b8e1-87eb5720a967 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:36.648315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:36.648911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:36.649243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:36.649520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] PATH_INFO: `/v3/users/f24f8625d40a439ead36415078e58c52` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:36.650726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24f8625d40a439ead36415078e58c52)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:36.652807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:36.679438 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:36.712609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24f8625d40a439ead36415078e58c52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.720696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24f8625d40a439ead36415078e58c52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.730245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24f8625d40a439ead36415078e58c52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.730900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24f8625d40a439ead36415078e58c52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.732135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24f8625d40a439ead36415078e58c52'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:36.753775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1283/2599] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:36 2022] DELETE /identity/v3/users/f24f8625d40a439ead36415078e58c52 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:36.801921 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:36.803337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:36.864881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d367f-43fc-4b32-8451-1bfdeb20182a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:36.919050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f4d2c-b93d-4442-ac70-a25c45205dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:36.920128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f4d2c-b93d-4442-ac70-a25c45205dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:36.920671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f4d2c-b93d-4442-ac70-a25c45205dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:36.921151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f4d2c-b93d-4442-ac70-a25c45205dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:36.923217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-797f4d2c-b93d-4442-ac70-a25c45205dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:36.937721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:36.991216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f4d2c-b93d-4442-ac70-a25c45205dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:36.992679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f4d2c-b93d-4442-ac70-a25c45205dc6 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.003443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1317/2600] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:37.129548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.131058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:37.157852 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a27ad-1443-4f80-9eb4-e183b84c52cc admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.163712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.164406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.164810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.165178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] PATH_INFO: `/v3/projects/536c0269f4314a1489c411d3cf49b749` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.166431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536c0269f4314a1489c411d3cf49b749)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.168453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.217996 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536c0269f4314a1489c411d3cf49b749', 'request_id': 'req-c77d82e7-335b-4a31-bdc9-0dbc4733b206'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:37.224408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536c0269f4314a1489c411d3cf49b749', 'request_id': 'req-c77d82e7-335b-4a31-bdc9-0dbc4733b206'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:37.230653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536c0269f4314a1489c411d3cf49b749', 'request_id': 'req-c77d82e7-335b-4a31-bdc9-0dbc4733b206'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:37.245209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] The token cache is being invalidate because project 536c0269f4314a1489c411d3cf49b749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:37.245503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:37.246138 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:37.247669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1284/2601] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:37 2022] DELETE /identity/v3/projects/536c0269f4314a1489c411d3cf49b749 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:37.252812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8334877-2847-42c7-94d5-2008f3de1c98 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.253169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8334877-2847-42c7-94d5-2008f3de1c98 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.253512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8334877-2847-42c7-94d5-2008f3de1c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.272981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f8334877-2847-42c7-94d5-2008f3de1c98 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:37.274283 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f8334877-2847-42c7-94d5-2008f3de1c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:37.322387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.323936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:37.343001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1318/2602] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:37.351756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156b99-093f-41f4-89af-5dc894508346 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.352564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156b99-093f-41f4-89af-5dc894508346 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.352852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156b99-093f-41f4-89af-5dc894508346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.375518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-92156b99-093f-41f4-89af-5dc894508346 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:37.376770 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-92156b99-093f-41f4-89af-5dc894508346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:37.385569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1319/2603] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:37.389428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92156b99-093f-41f4-89af-5dc894508346 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.398989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92156b99-093f-41f4-89af-5dc894508346 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.404615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.406393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.406393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.406393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.406868 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:37.407237 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.409067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.410803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d82e7-335b-4a31-bdc9-0dbc4733b206 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.418153 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.418683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.419539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.419788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.421584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:37.423550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1320/2604] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:36:37.427811 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.438760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e25ab4-a5e4-498a-810c-a74d72cb9268 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.440810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:37.443604 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.444200 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.444677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.444951 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.445986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.447876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.480148 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1321/2605] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:36:37.485151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.493466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.495065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.504974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1285/2606] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:36:37.567026 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdc750-e7e4-4f99-b6cd-5bd3e4592c9f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.571985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.572756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.573113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.573730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.574172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.576925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.597426 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:37.604775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1322/2607] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:37 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:37.608759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.621579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38043-763f-4c06-a246-fdbb84ec2276 service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.626595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.627572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.627755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.628023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.628702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.630893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.645995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1286/2608] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:36:37.647161 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.657783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb421f-5173-4fdb-9452-4b2b77a15835 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.665316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38755cfa-fbdd-47d2-aa03-f053b0e72724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.666171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38755cfa-fbdd-47d2-aa03-f053b0e72724 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.666442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38755cfa-fbdd-47d2-aa03-f053b0e72724 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.666854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38755cfa-fbdd-47d2-aa03-f053b0e72724 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.667696 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38755cfa-fbdd-47d2-aa03-f053b0e72724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.669500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38755cfa-fbdd-47d2-aa03-f053b0e72724 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.680276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1323/2609] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:36:37.684960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:37.698134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8411-99fd-4841-945d-a3fc94425ae1 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:37.703762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:37.704445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.704727 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.705021 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] PATH_INFO: `/v3/projects/da1aa6a1b79c463a997b2231322e880b/users/658d996b9ee64e4896a5420efa951f3f/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.723938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1aa6a1b79c463a997b2231322e880b, user_id=658d996b9ee64e4896a5420efa951f3f, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:37.726662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:37.743838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1287/2610] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:37 2022] PUT /identity/v3/projects/da1aa6a1b79c463a997b2231322e880b/users/658d996b9ee64e4896a5420efa951f3f/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:37.815710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fa506-df10-43a4-950a-769388aa98b0 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:37.816000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fa506-df10-43a4-950a-769388aa98b0 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:37.816309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fa506-df10-43a4-950a-769388aa98b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:37.859910 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-338fa506-df10-43a4-950a-769388aa98b0 None None] MFA Rules not processed for user `658d996b9ee64e4896a5420efa951f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:37.861168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-338fa506-df10-43a4-950a-769388aa98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:37.940908 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1324/2611] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:37.945416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:38.014406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464872-e945-46f3-8e33-8ad0324b5bff admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:38.019973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:38.020720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.021071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.021411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.022114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:38.024111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:38.056413 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1288/2612] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:38.060436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fa506-df10-43a4-950a-769388aa98b0 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:38.074275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fa506-df10-43a4-950a-769388aa98b0 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:38.147066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:38.147594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.148018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.148298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.148992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:38.150969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:38.186269 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1325/2613] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:38 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:38.187729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:38.200838 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8e44-b25c-4968-bd6c-6fe96b2beac0 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:38.206881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:38.207816 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.208304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.208955 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.209985 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:38.212616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:38.229007 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1289/2614] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:38.234443 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:38.246302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd1d9-6435-48be-8e6e-5f2487639b87 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:38.251248 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:38.251891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.252226 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.252535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] PATH_INFO: `/v3/projects/e448f08572314a54b5d83cdf48b1155d/users/4b11d14dacc248669a6d0bedf9da7356/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.268975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e448f08572314a54b5d83cdf48b1155d, user_id=4b11d14dacc248669a6d0bedf9da7356, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:38.271782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:38.288216 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1326/2615] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:38 2022] PUT /identity/v3/projects/e448f08572314a54b5d83cdf48b1155d/users/4b11d14dacc248669a6d0bedf9da7356/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:38.292170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:38.303066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8704ac-3911-4c88-abb5-01d82283eb4b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:38.361345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:38.370960 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200c5b7-6622-49c5-9cf3-83d562635f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:38.371564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200c5b7-6622-49c5-9cf3-83d562635f2f admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.371839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200c5b7-6622-49c5-9cf3-83d562635f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.372730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200c5b7-6622-49c5-9cf3-83d562635f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.373373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200c5b7-6622-49c5-9cf3-83d562635f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:38.374976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200c5b7-6622-49c5-9cf3-83d562635f2f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:38.385697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1290/2616] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:36:38.390143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:38.400524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9531e0e-d6d4-430b-b03a-f63c771b72db admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:38.405251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:38.405974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.406415 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.406753 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] PATH_INFO: `/v3/projects/e448f08572314a54b5d83cdf48b1155d/users/4b11d14dacc248669a6d0bedf9da7356/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.408771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e448f08572314a54b5d83cdf48b1155d, user_id=4b11d14dacc248669a6d0bedf9da7356, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:38.411440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:38.422306 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1327/2617] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:38 2022] PUT /identity/v3/projects/e448f08572314a54b5d83cdf48b1155d/users/4b11d14dacc248669a6d0bedf9da7356/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:38.432569 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e487426-6fcc-41d9-851a-8c06cc85db7b None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.432858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e487426-6fcc-41d9-851a-8c06cc85db7b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.433137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e487426-6fcc-41d9-851a-8c06cc85db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.461792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4e487426-6fcc-41d9-851a-8c06cc85db7b None None] MFA Rules not processed for user `4b11d14dacc248669a6d0bedf9da7356`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:38.462929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4e487426-6fcc-41d9-851a-8c06cc85db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:38.547406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1291/2618] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:38.558873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:38.560844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:38.601727 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:38.636710 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf02a-04dd-464d-91d8-7015d6fd6328 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:38.642890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7bf2-6c8e-468e-9605-0c9c871596b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:38.644535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7bf2-6c8e-468e-9605-0c9c871596b7 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:38.644918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7bf2-6c8e-468e-9605-0c9c871596b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:38.645333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7bf2-6c8e-468e-9605-0c9c871596b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:38.656168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7bf2-6c8e-468e-9605-0c9c871596b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:38.657761 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7bf2-6c8e-468e-9605-0c9c871596b7 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:38.669655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1328/2619] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:39.401683 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e487426-6fcc-41d9-851a-8c06cc85db7b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:39.483952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e487426-6fcc-41d9-851a-8c06cc85db7b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:39.489284 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:39.490056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:39.490398 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:39.490735 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] PATH_INFO: `/v3/users/658d996b9ee64e4896a5420efa951f3f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:39.491954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658d996b9ee64e4896a5420efa951f3f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:39.494051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:39.560878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658d996b9ee64e4896a5420efa951f3f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:39.569434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658d996b9ee64e4896a5420efa951f3f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:39.577860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658d996b9ee64e4896a5420efa951f3f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:39.578494 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658d996b9ee64e4896a5420efa951f3f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:39.579098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658d996b9ee64e4896a5420efa951f3f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:39.592251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:39.603347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1292/2620] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:39 2022] DELETE /identity/v3/users/658d996b9ee64e4896a5420efa951f3f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:39.608832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:39.609351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:39.609351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:39.632140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:39.633401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:39.697711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1329/2621] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:39.707920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:39.709434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:39.774477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b04c0-3836-4877-9ba6-36a11d6355d6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:39.778664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:39.779289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:39.779560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:39.779830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:39.790086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:39.791716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:39.802116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1293/2622] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:40.138322 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:40.141025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:40.158978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca08d9f-6135-4671-add7-53d7663bd34e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:40.169309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:40.170598 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:40.171089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:40.172014 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] PATH_INFO: `/v3/projects/da1aa6a1b79c463a997b2231322e880b` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:40.176751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1aa6a1b79c463a997b2231322e880b)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:40.183271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:40.350777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1aa6a1b79c463a997b2231322e880b', 'request_id': 'req-d87a321c-17db-46d9-9d25-311e15a40d96'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.366878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1aa6a1b79c463a997b2231322e880b', 'request_id': 'req-d87a321c-17db-46d9-9d25-311e15a40d96'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.381787 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1aa6a1b79c463a997b2231322e880b', 'request_id': 'req-d87a321c-17db-46d9-9d25-311e15a40d96'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.398867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] The token cache is being invalidate because project da1aa6a1b79c463a997b2231322e880b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:40.399405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.400578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.405501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1330/2623] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:40 2022] DELETE /identity/v3/projects/da1aa6a1b79c463a997b2231322e880b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:40.409578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:40.421014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a1feb-283a-4866-af10-eba4d51d6a7c service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:40.534088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:40.534964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:40.535392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:40.535780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] PATH_INFO: `/v3/users/4b11d14dacc248669a6d0bedf9da7356` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:40.537068 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b11d14dacc248669a6d0bedf9da7356)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:40.539111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:40.543303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:40.543303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:40.603824 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b11d14dacc248669a6d0bedf9da7356'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.613502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b11d14dacc248669a6d0bedf9da7356'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.623492 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b11d14dacc248669a6d0bedf9da7356'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.623793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:40.625235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b11d14dacc248669a6d0bedf9da7356'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.625977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b11d14dacc248669a6d0bedf9da7356'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.646239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a321c-17db-46d9-9d25-311e15a40d96 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:40.647877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1294/2624] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:40 2022] DELETE /identity/v3/users/4b11d14dacc248669a6d0bedf9da7356 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:40.648740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:40.650077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:40.680582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:40.723901 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:40.724765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:40.725128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:40.725411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:40.727493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:40.738681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfed9c2-a0dd-4f3c-a18f-ef2e13aa197f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:40.741020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:40.743436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:40.743623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:40.744256 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:40.744525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:40.744807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] PATH_INFO: `/v3/users/562fcce5b9be41908036832d4aed1dff` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:40.745966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562fcce5b9be41908036832d4aed1dff)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:40.748122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:40.754511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1331/2625] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:36:40.805480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562fcce5b9be41908036832d4aed1dff'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.813716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562fcce5b9be41908036832d4aed1dff'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.821572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562fcce5b9be41908036832d4aed1dff'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.822359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562fcce5b9be41908036832d4aed1dff'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.823064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562fcce5b9be41908036832d4aed1dff'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:40.842151 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1295/2626] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:40 2022] DELETE /identity/v3/users/562fcce5b9be41908036832d4aed1dff => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:40.930066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:40.931918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:40.949511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe71f4-7e0b-4b51-ab2d-2c629c3a794a service placement] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.024984 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.025627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.025903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.026174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] PATH_INFO: `/v3/projects/e448f08572314a54b5d83cdf48b1155d` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.027837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e448f08572314a54b5d83cdf48b1155d)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.028891 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.030132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.030947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.060258 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed36c17-ef7a-4969-a87e-057a22df9d91 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.065422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.066056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.066411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.066598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] PATH_INFO: `/v3/projects/9885c6da9fd6420eb736de5d93193830` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.067739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9885c6da9fd6420eb736de5d93193830)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.069695 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.080662 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e448f08572314a54b5d83cdf48b1155d', 'request_id': 'req-495df055-abf0-47fd-bdf0-bd670b7a57eb'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.086781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e448f08572314a54b5d83cdf48b1155d', 'request_id': 'req-495df055-abf0-47fd-bdf0-bd670b7a57eb'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.094347 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e448f08572314a54b5d83cdf48b1155d', 'request_id': 'req-495df055-abf0-47fd-bdf0-bd670b7a57eb'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.105826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] The token cache is being invalidate because project e448f08572314a54b5d83cdf48b1155d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:41.106109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.106771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-495df055-abf0-47fd-bdf0-bd670b7a57eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.108261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1332/2627] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:40 2022] DELETE /identity/v3/projects/e448f08572314a54b5d83cdf48b1155d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:41.113024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771329f4-68d6-4cd0-9750-61aaf5fa8c8b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.113436 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771329f4-68d6-4cd0-9750-61aaf5fa8c8b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.113799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771329f4-68d6-4cd0-9750-61aaf5fa8c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.118152 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9885c6da9fd6420eb736de5d93193830', 'request_id': 'req-4f269b24-a432-4410-aa77-b6ab8aa13b5d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.125925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9885c6da9fd6420eb736de5d93193830', 'request_id': 'req-4f269b24-a432-4410-aa77-b6ab8aa13b5d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.131530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9885c6da9fd6420eb736de5d93193830', 'request_id': 'req-4f269b24-a432-4410-aa77-b6ab8aa13b5d'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.134215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-771329f4-68d6-4cd0-9750-61aaf5fa8c8b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:41.135185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-771329f4-68d6-4cd0-9750-61aaf5fa8c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.144862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] The token cache is being invalidate because project 9885c6da9fd6420eb736de5d93193830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:41.145154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.145871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-4f269b24-a432-4410-aa77-b6ab8aa13b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:41.147582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1296/2628] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:41 2022] DELETE /identity/v3/projects/9885c6da9fd6420eb736de5d93193830 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:41.149379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:41.152480 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0809-464a-4971-87af-186fd6b57210 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.152772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0809-464a-4971-87af-186fd6b57210 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.153048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a0809-464a-4971-87af-186fd6b57210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.173772 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-465a0809-464a-4971-87af-186fd6b57210 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:41.175203 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-465a0809-464a-4971-87af-186fd6b57210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.189056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:41.197505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1333/2629] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:41.206106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c0125-5706-42bb-a4cb-3904c0be1a4a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.206396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c0125-5706-42bb-a4cb-3904c0be1a4a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.206669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c0125-5706-42bb-a4cb-3904c0be1a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.225793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f33c0125-5706-42bb-a4cb-3904c0be1a4a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:41.226975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f33c0125-5706-42bb-a4cb-3904c0be1a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.236948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1334/2630] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:41.238811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1297/2631] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:41.240962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c0125-5706-42bb-a4cb-3904c0be1a4a None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.247779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedf6b-4d76-46f8-934d-b7f6eace23b7 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.248063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedf6b-4d76-46f8-934d-b7f6eace23b7 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.248330 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedf6b-4d76-46f8-934d-b7f6eace23b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.251215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c0125-5706-42bb-a4cb-3904c0be1a4a None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.256193 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.256835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.257110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.257379 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.258095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:41.262391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.262391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.271472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-3dcedf6b-4d76-46f8-934d-b7f6eace23b7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:41.272677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3dcedf6b-4d76-46f8-934d-b7f6eace23b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.273924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1335/2632] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:36:41.278025 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.283525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1298/2633] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:41.287842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a67582-a572-48de-b20a-5a936ffa5222 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.287979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedf6b-4d76-46f8-934d-b7f6eace23b7 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.292551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.293225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.293505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.294297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.294957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.296879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.297487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedf6b-4d76-46f8-934d-b7f6eace23b7 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.302034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.302642 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.302914 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.303180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.304481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:41.304792 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.306374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.323061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1299/2634] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:36:41.324115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.327506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1336/2635] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:36:41.331494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.333878 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc497c32-5f33-4bb3-b4c5-1f3e3bb26a48 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.392851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b495-aa33-4c91-8ed3-f5e2b1233899 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.394429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.395034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.395314 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.395610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.396264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.397729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.398206 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.398370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.398582 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.398852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.399473 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.401401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.423319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1337/2636] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:36:41.428441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1300/2637] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:41.428914 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.429351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.438122 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fefdfe-ebd1-48ee-960f-920455c9ba27 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.498448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.499131 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.499480 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.499876 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.507820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.507820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.508050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa3f99-fe39-4ee9-b666-87130784e0af admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.511282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.512002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.512328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1338/2638] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:41.516107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.526323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.526323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.526829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e3177-32e1-4fa2-aec1-2ae6b3df6c6f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.526964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.528596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:41.529482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.534758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.535550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.535999 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.536455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.537523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.539998 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.553134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1339/2639] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:36:41.554455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1301/2640] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/users => generated 279 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:36:41.557319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.558141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.573350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c4d3a-256b-4196-9f8b-8fe537eb3b1f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.574593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c0bd4-79ed-4051-8ece-33316983e0b4 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.582536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.582891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc4f43-dc44-49a7-a401-87735209f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.583142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.583425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.583542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4f43-dc44-49a7-a401-87735209f089 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.583714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.583816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4f43-dc44-49a7-a401-87735209f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.584058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc4f43-dc44-49a7-a401-87735209f089 admin admin] PATH_INFO: `/v3/projects/2701cfc9129947b19d33258f6f99503e/users/e683d8ac03f34ff8ae235f0d80cc18c7/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.584324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.586008 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.597412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1302/2641] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:41.601831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.601968 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc4f43-dc44-49a7-a401-87735209f089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2701cfc9129947b19d33258f6f99503e, user_id=e683d8ac03f34ff8ae235f0d80cc18c7, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.605221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc4f43-dc44-49a7-a401-87735209f089 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.611464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:41.617102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d49468-0171-4d95-b0d7-7e092f5f21f7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.623461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1340/2642] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:41 2022] PUT /identity/v3/projects/2701cfc9129947b19d33258f6f99503e/users/e683d8ac03f34ff8ae235f0d80cc18c7/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:41.636074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.636074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.636074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.668439 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] MFA Rules not processed for user `e683d8ac03f34ff8ae235f0d80cc18c7`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:41.670273 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.699848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.700679 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.701058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.701450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.702573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.704601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.715120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1303/2643] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:36:41.719945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.730034 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d12fe4-3e77-42ba-af29-6ed52b1ef7ed admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.736770 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645f597-cdeb-406c-8de6-2c54c328ec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.737535 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645f597-cdeb-406c-8de6-2c54c328ec5c admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.737900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645f597-cdeb-406c-8de6-2c54c328ec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.738360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645f597-cdeb-406c-8de6-2c54c328ec5c admin admin] PATH_INFO: `/v3/projects/cef80ba2dbff4bc084bc8e850bf15519/users/774d6ba4988145ce9d8034b620d85380/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.752192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1341/2644] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:41.757217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645f597-cdeb-406c-8de6-2c54c328ec5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef80ba2dbff4bc084bc8e850bf15519, user_id=774d6ba4988145ce9d8034b620d85380, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:41.759896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645f597-cdeb-406c-8de6-2c54c328ec5c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:41.760530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.762000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.774332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1304/2645] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:41 2022] PUT /identity/v3/projects/cef80ba2dbff4bc084bc8e850bf15519/users/774d6ba4988145ce9d8034b620d85380/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:41.786070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a57b7-b131-4715-928c-d9455a044c02 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.786355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a57b7-b131-4715-928c-d9455a044c02 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.787361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a57b7-b131-4715-928c-d9455a044c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.830714 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bcde9-a204-4bc8-b999-0b19265723ac None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:41.832281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-bc8a57b7-b131-4715-928c-d9455a044c02 None None] MFA Rules not processed for user `774d6ba4988145ce9d8034b620d85380`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:41.834329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bc8a57b7-b131-4715-928c-d9455a044c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:41.906400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:41.907271 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:41.907708 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:41.908157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:41.936551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1305/2646] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:41.943146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a57b7-b131-4715-928c-d9455a044c02 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:41.960713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:42.000224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.001701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.023932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1342/2647] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:36:42.041696 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a57b7-b131-4715-928c-d9455a044c02 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.047143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.047745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.048038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.048276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.049238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.051130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.062624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:42.080594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1306/2648] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:41 2022] POST /identity/v3/projects => generated 355 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:42.084572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:42.096268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8183c6-3255-4a77-8cd1-f54d79f785e4 service glance] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.157865 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.158541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.158886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.159223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.159915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.161906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.186606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1343/2649] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:42 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:42.187787 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:42.197978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b681-57ce-4eb8-ad71-328b839977b0 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.203118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.203714 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.203987 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.204253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.204924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.206505 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.220999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1307/2650] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:36:42.222562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:42.235444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b8782-b656-4170-ba6e-7206658ddc8f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.241162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.241827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.242105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.242378 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] PATH_INFO: `/v3/projects/c07b85c6bf47440eacd947946eca4cc8/users/78986c90262448a49f90cc5188237fb0/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.257917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07b85c6bf47440eacd947946eca4cc8, user_id=78986c90262448a49f90cc5188237fb0, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.260666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.275563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1344/2651] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:42 2022] PUT /identity/v3/projects/c07b85c6bf47440eacd947946eca4cc8/users/78986c90262448a49f90cc5188237fb0/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:42.280105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:42.291094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94efd4f-aff8-4c25-bb0b-29a2dd06bd08 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.358075 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea24b-d7e5-4b46-8a80-ba92fd3b9bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.358685 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea24b-d7e5-4b46-8a80-ba92fd3b9bfc admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.358964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea24b-d7e5-4b46-8a80-ba92fd3b9bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.359243 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea24b-d7e5-4b46-8a80-ba92fd3b9bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.359925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaea24b-d7e5-4b46-8a80-ba92fd3b9bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.361773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaea24b-d7e5-4b46-8a80-ba92fd3b9bfc admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.375926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1308/2652] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:36:42.380293 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:42.394318 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7cd04-cee0-4a35-986b-a2723c345d04 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.399172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.400050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.400173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.400693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] PATH_INFO: `/v3/projects/c07b85c6bf47440eacd947946eca4cc8/users/78986c90262448a49f90cc5188237fb0/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.402671 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07b85c6bf47440eacd947946eca4cc8, user_id=78986c90262448a49f90cc5188237fb0, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.406100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.417826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1345/2653] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:42 2022] PUT /identity/v3/projects/c07b85c6bf47440eacd947946eca4cc8/users/78986c90262448a49f90cc5188237fb0/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:42.429877 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b459-4887-48aa-af27-93b7a0bb371a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.430379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b459-4887-48aa-af27-93b7a0bb371a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.432541 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b459-4887-48aa-af27-93b7a0bb371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.476930 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-3226b459-4887-48aa-af27-93b7a0bb371a None None] MFA Rules not processed for user `78986c90262448a49f90cc5188237fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:42.479245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3226b459-4887-48aa-af27-93b7a0bb371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:42.573767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1309/2654] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:42.586246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:42.587997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:42.646088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be75c-1bc2-4f25-b5d6-c8c11d290e34 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.649917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.650524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.650814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.651134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.660500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.661952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.671497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1346/2655] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:42.746131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226b459-4887-48aa-af27-93b7a0bb371a None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:42.756745 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226b459-4887-48aa-af27-93b7a0bb371a None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:42.760298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:42.760923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:42.761196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:42.761461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:42.820938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:42.822509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:42.827213 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:42.834352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1310/2656] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:51.219905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:51.221325 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:51.252059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:51.282452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6163-b59c-4c67-811e-f16873928180 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:51.286076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:51.286682 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:51.286957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:51.287227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:51.289028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:51.350634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:51.351995 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:51.362425 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1347/2657] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:54.578813 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:54.580672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:54.597125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467d16-ef31-4f6f-b754-66dc94ab57a4 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:54.602296 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:54.602986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:54.603267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:54.603536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] PATH_INFO: `/v3/users/bca116e3c8de4cf2aac77028c7e40a4f` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:54.604820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca116e3c8de4cf2aac77028c7e40a4f)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:54.606820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:54.669362 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca116e3c8de4cf2aac77028c7e40a4f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:54.677109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca116e3c8de4cf2aac77028c7e40a4f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:54.684956 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca116e3c8de4cf2aac77028c7e40a4f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:54.685579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca116e3c8de4cf2aac77028c7e40a4f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:54.686187 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-e706b0c3-aad1-4428-a3cf-a85f547474b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca116e3c8de4cf2aac77028c7e40a4f'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:54.703666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1311/2658] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:54 2022] DELETE /identity/v3/users/bca116e3c8de4cf2aac77028c7e40a4f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:54.872532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:54.884562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f744a-d846-4319-a7f3-b81b87505371 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:54.946513 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:54.947156 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:54.947978 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:54.948261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] PATH_INFO: `/v3/projects/c6894b8e02e74ba59c44fb3f223d347e` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:54.949444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6894b8e02e74ba59c44fb3f223d347e)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:54.951456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.008897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6894b8e02e74ba59c44fb3f223d347e', 'request_id': 'req-c4e93013-881e-4152-8e1a-ccb4e1a66444'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:55.015227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6894b8e02e74ba59c44fb3f223d347e', 'request_id': 'req-c4e93013-881e-4152-8e1a-ccb4e1a66444'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:55.023132 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6894b8e02e74ba59c44fb3f223d347e', 'request_id': 'req-c4e93013-881e-4152-8e1a-ccb4e1a66444'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:55.033509 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] The token cache is being invalidate because project c6894b8e02e74ba59c44fb3f223d347e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:55.033797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:55.034449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c4e93013-881e-4152-8e1a-ccb4e1a66444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:55.036041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1348/2659] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:54 2022] DELETE /identity/v3/projects/c6894b8e02e74ba59c44fb3f223d347e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:55.041026 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c536cc-f42f-44a3-9596-e76eb1e1d21a None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.041392 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c536cc-f42f-44a3-9596-e76eb1e1d21a None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.041760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c536cc-f42f-44a3-9596-e76eb1e1d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.063481 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e2c536cc-f42f-44a3-9596-e76eb1e1d21a None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:55.064514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e2c536cc-f42f-44a3-9596-e76eb1e1d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:55.135087 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1312/2660] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:55.143661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a437-5b48-43f0-9af2-6c983be47115 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.144077 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a437-5b48-43f0-9af2-6c983be47115 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.144238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a437-5b48-43f0-9af2-6c983be47115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.153917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:55.167129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-dde3a437-5b48-43f0-9af2-6c983be47115 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:55.168944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-dde3a437-5b48-43f0-9af2-6c983be47115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:55.177576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1349/2661] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:36:55.181715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c536cc-f42f-44a3-9596-e76eb1e1d21a None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.191895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c536cc-f42f-44a3-9596-e76eb1e1d21a None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.196681 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.197321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.197603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.197875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.198564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:55.198823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.201080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.212651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1313/2662] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:55.217358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a437-5b48-43f0-9af2-6c983be47115 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.227928 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a437-5b48-43f0-9af2-6c983be47115 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.233035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.233701 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.233877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.234136 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.234892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.236746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.263256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1350/2663] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:55 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:55.267686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.277610 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509155dd-0395-41d0-8f62-f38f738e1407 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.332952 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.333482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.333760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.334033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.334658 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.336587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.344349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:55.359345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1314/2664] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:55 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:55.363476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.374280 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe57a5-f926-4ce9-93f9-d841c6b156ba admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.378911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.379502 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.379778 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.380047 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.380722 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.382304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.518664 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1351/2665] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:55.522764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.532743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70bf1a-58a0-4b72-aad4-361acb12a578 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.537312 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145896f3-d1e6-4aa9-8b3f-20d98ca6b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.537920 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145896f3-d1e6-4aa9-8b3f-20d98ca6b73c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.538196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145896f3-d1e6-4aa9-8b3f-20d98ca6b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.538463 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145896f3-d1e6-4aa9-8b3f-20d98ca6b73c admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.539091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145896f3-d1e6-4aa9-8b3f-20d98ca6b73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.540712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145896f3-d1e6-4aa9-8b3f-20d98ca6b73c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.551510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1315/2666] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:55.555677 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.566157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51aaa6-135d-4bb4-9f07-1762a6c7844a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.570689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.571326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.571603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.571875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] PATH_INFO: `/v3/projects/a1a1492c7da44cf0a55cd4b2ab579b0c/users/924f781cabe74d22bf25f7578e7034a9/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.585952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a1492c7da44cf0a55cd4b2ab579b0c, user_id=924f781cabe74d22bf25f7578e7034a9, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.588548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.601239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1352/2667] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:55 2022] PUT /identity/v3/projects/a1a1492c7da44cf0a55cd4b2ab579b0c/users/924f781cabe74d22bf25f7578e7034a9/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:55.612786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a56f-e235-4e37-a1a5-cb029ec79787 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.613287 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a56f-e235-4e37-a1a5-cb029ec79787 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.613390 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a56f-e235-4e37-a1a5-cb029ec79787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.640817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e6a9a56f-e235-4e37-a1a5-cb029ec79787 None None] MFA Rules not processed for user `924f781cabe74d22bf25f7578e7034a9`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:55.642028 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e6a9a56f-e235-4e37-a1a5-cb029ec79787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:55.706080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1316/2668] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:55.710581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.770932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14524-9a39-4efa-9275-74bfe8a13a50 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.775560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.776153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.776453 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.776725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.777336 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.779212 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.805417 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1353/2669] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:55 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:55.810110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a56f-e235-4e37-a1a5-cb029ec79787 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.821249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a56f-e235-4e37-a1a5-cb029ec79787 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.877051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.877573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.877849 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.878119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.878739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.880651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.901578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1317/2670] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:55 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:55.906738 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.917154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfab1c-25c6-4a29-b738-fd8ba7b5fae2 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.922389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.922983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.923261 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.923530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.924167 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.925828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.935634 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1354/2671] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:55.939588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:55.949977 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091fa4d-f05a-4d78-acef-d237c33aa554 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:55.954641 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:55.955278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:55.955557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:55.955829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] PATH_INFO: `/v3/projects/b697b1d18c3740ddb1c3efb8ddaa2828/users/73459776b8ad45e1ae24b30ed5e016d0/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:55.970741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b697b1d18c3740ddb1c3efb8ddaa2828, user_id=73459776b8ad45e1ae24b30ed5e016d0, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:55.973684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:55.986885 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1318/2672] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:55 2022] PUT /identity/v3/projects/b697b1d18c3740ddb1c3efb8ddaa2828/users/73459776b8ad45e1ae24b30ed5e016d0/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:55.990755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:56.000745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470f92-effa-42be-ab3c-399071f7ff01 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:56.057124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984a16-40d9-4ee3-be07-01f3e9ef099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:56.057694 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984a16-40d9-4ee3-be07-01f3e9ef099a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:56.057971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984a16-40d9-4ee3-be07-01f3e9ef099a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:56.058247 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984a16-40d9-4ee3-be07-01f3e9ef099a admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:56.058873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984a16-40d9-4ee3-be07-01f3e9ef099a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:56.060531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984a16-40d9-4ee3-be07-01f3e9ef099a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:56.070523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1355/2673] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:56.074922 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:56.085103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c72f0-052a-45c8-ac53-fd1372247795 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:56.089773 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:56.090898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:56.091180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:56.091450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] PATH_INFO: `/v3/projects/b697b1d18c3740ddb1c3efb8ddaa2828/users/73459776b8ad45e1ae24b30ed5e016d0/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:56.093403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b697b1d18c3740ddb1c3efb8ddaa2828, user_id=73459776b8ad45e1ae24b30ed5e016d0, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:56.096058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:56.106929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1319/2674] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:56 2022] PUT /identity/v3/projects/b697b1d18c3740ddb1c3efb8ddaa2828/users/73459776b8ad45e1ae24b30ed5e016d0/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:56.116900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:56.117211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:56.117486 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:56.137317 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:56.146345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] MFA Rules not processed for user `73459776b8ad45e1ae24b30ed5e016d0`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:56.148221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:56.218845 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1356/2675] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:56.252811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:56.254723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:56.277250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:56.326760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a0bb6-4188-4c24-b5a2-c2c78a15db75 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:56.330452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:56.331063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:56.331337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:56.331608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:56.342029 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:56.343473 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:56.353660 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1320/2676] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:56.477474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:56.477474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:56.487050 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de91063-5a7c-4abf-9947-dc26ae3153f2 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:56.491175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca78f97-e59e-4b53-8514-8b14899a91ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:56.491751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca78f97-e59e-4b53-8514-8b14899a91ad service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:56.492065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca78f97-e59e-4b53-8514-8b14899a91ad service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:56.492331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca78f97-e59e-4b53-8514-8b14899a91ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:56.556175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca78f97-e59e-4b53-8514-8b14899a91ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:56.557629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca78f97-e59e-4b53-8514-8b14899a91ad service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:56.566842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1357/2677] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:58.120850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:58.122369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:58.199562 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34c88-d7d7-4261-9833-78f123db7994 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:58.204835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:58.205501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:58.205769 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:58.206043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] PATH_INFO: `/v3/users/774d6ba4988145ce9d8034b620d85380` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:58.207199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=774d6ba4988145ce9d8034b620d85380)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:58.209302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:58.257940 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774d6ba4988145ce9d8034b620d85380'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.265361 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774d6ba4988145ce9d8034b620d85380'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.272761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774d6ba4988145ce9d8034b620d85380'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.273444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774d6ba4988145ce9d8034b620d85380'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.274113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774d6ba4988145ce9d8034b620d85380'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.291266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1321/2678] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:58 2022] DELETE /identity/v3/users/774d6ba4988145ce9d8034b620d85380 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:58.295762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:58.296267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:58.296400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:58.316128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:58.317380 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:58.375270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1358/2679] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:58.384999 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:58.386378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:58.430822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:58.444332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079b57-23ee-4710-acdf-e7f7bba926e2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:58.448027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:58.448649 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:58.448928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:58.449198 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:58.458809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:58.460221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:58.469598 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1322/2680] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:36:58.740624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:58.742062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:58.754043 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2138b-31ba-49e5-b99a-058191600228 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:58.758635 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:58.759268 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:58.759546 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:58.759817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] PATH_INFO: `/v3/projects/cef80ba2dbff4bc084bc8e850bf15519` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:58.761011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef80ba2dbff4bc084bc8e850bf15519)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:58.762917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:58.798181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:58.811497 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef80ba2dbff4bc084bc8e850bf15519', 'request_id': 'req-506cdf01-1fa6-455a-a52b-e70426b4df4a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.817649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef80ba2dbff4bc084bc8e850bf15519', 'request_id': 'req-506cdf01-1fa6-455a-a52b-e70426b4df4a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.825264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef80ba2dbff4bc084bc8e850bf15519', 'request_id': 'req-506cdf01-1fa6-455a-a52b-e70426b4df4a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.836501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] The token cache is being invalidate because project cef80ba2dbff4bc084bc8e850bf15519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:58.836790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.837403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.838902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1359/2681] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:58 2022] DELETE /identity/v3/projects/cef80ba2dbff4bc084bc8e850bf15519 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:58.843611 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:58.853579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202814d-78ca-439f-83d9-a44577492b9f service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:58.911522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:58.912148 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:58.912454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:58.912834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] PATH_INFO: `/v3/users/78986c90262448a49f90cc5188237fb0` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:58.913954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=78986c90262448a49f90cc5188237fb0)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:58.915872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:58.964925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78986c90262448a49f90cc5188237fb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.972348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78986c90262448a49f90cc5188237fb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.980342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78986c90262448a49f90cc5188237fb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.981012 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78986c90262448a49f90cc5188237fb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:58.981623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1aec0bd2-553d-44b4-97b3-2a6dfd3988cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78986c90262448a49f90cc5188237fb0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:59.000086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1323/2682] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:36:58 2022] DELETE /identity/v3/users/78986c90262448a49f90cc5188237fb0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:59.283390 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:59.285020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:59.298944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cdf01-1fa6-455a-a52b-e70426b4df4a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:59.361529 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:59.362246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.362523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.362795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] PATH_INFO: `/v3/projects/c07b85c6bf47440eacd947946eca4cc8` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.363903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07b85c6bf47440eacd947946eca4cc8)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:59.365942 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:59.413202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07b85c6bf47440eacd947946eca4cc8', 'request_id': 'req-d4241a6c-032f-47f3-b358-47fe7dc65f01'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:59.420115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07b85c6bf47440eacd947946eca4cc8', 'request_id': 'req-d4241a6c-032f-47f3-b358-47fe7dc65f01'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:59.428689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07b85c6bf47440eacd947946eca4cc8', 'request_id': 'req-d4241a6c-032f-47f3-b358-47fe7dc65f01'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:59.438997 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] The token cache is being invalidate because project c07b85c6bf47440eacd947946eca4cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:36:59.439304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:59.439933 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d4241a6c-032f-47f3-b358-47fe7dc65f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:36:59.441468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1360/2683] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:36:59 2022] DELETE /identity/v3/projects/c07b85c6bf47440eacd947946eca4cc8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:36:59.446337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557499fd-d749-49ba-b14b-d73185e96f7d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.446800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557499fd-d749-49ba-b14b-d73185e96f7d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.447018 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557499fd-d749-49ba-b14b-d73185e96f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.468111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-557499fd-d749-49ba-b14b-d73185e96f7d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:59.469508 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-557499fd-d749-49ba-b14b-d73185e96f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:59.532796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1324/2684] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:59.540894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061eb21-12e5-4b49-b484-5b6d9012d399 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.541214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061eb21-12e5-4b49-b484-5b6d9012d399 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.541527 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061eb21-12e5-4b49-b484-5b6d9012d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.561264 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-1061eb21-12e5-4b49-b484-5b6d9012d399 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:59.562451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1061eb21-12e5-4b49-b484-5b6d9012d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:36:59.570729 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1361/2685] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:36:59.575058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557499fd-d749-49ba-b14b-d73185e96f7d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:59.582482 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:59.586401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557499fd-d749-49ba-b14b-d73185e96f7d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:59.594346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:59.594994 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.595459 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.595730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.596406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:36:59.596716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:59.598588 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:59.612672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1325/2686] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:36:59.617127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061eb21-12e5-4b49-b484-5b6d9012d399 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:59.626484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061eb21-12e5-4b49-b484-5b6d9012d399 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:59.631134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:59.631809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.632039 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.632361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.633103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:59.635109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:59.663902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1362/2687] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:36:59 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:59.668212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:59.678445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18692-1266-4b12-9b6e-b1561502642b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:59.738643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:59.739268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.739643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.740001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.740971 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:59.743248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:59.767584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1326/2688] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:36:59 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:36:59.771830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:59.783348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1365f04-512a-4b7f-bad4-866a91920b4f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:59.788308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:59.789027 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.789364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.789697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.790397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:59.792100 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:59.802408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1363/2689] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:59.807022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:59.817842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408006b-c530-40e2-ac82-b3a58876451d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:59.823542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18395a7e-2002-417d-ba6b-393f42820aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:59.824143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395a7e-2002-417d-ba6b-393f42820aab admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.824452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395a7e-2002-417d-ba6b-393f42820aab admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.824729 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395a7e-2002-417d-ba6b-393f42820aab admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.825389 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18395a7e-2002-417d-ba6b-393f42820aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:59.827525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18395a7e-2002-417d-ba6b-393f42820aab admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:59.841557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1327/2690] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:36:59.842697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:36:59.853097 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c5b3-754c-4648-b7d6-5bac8a344c3c admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:36:59.857972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:36:59.858621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.858902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.859177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] PATH_INFO: `/v3/projects/1ec295b691d44e75b8012dd70a170282/users/90ee002ef8fd45d88f39e420b3006357/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.863517 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:59.881220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec295b691d44e75b8012dd70a170282, user_id=90ee002ef8fd45d88f39e420b3006357, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:36:59.881220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:36:59.894935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1364/2691] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:36:59 2022] PUT /identity/v3/projects/1ec295b691d44e75b8012dd70a170282/users/90ee002ef8fd45d88f39e420b3006357/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:36:59.905272 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c24fe-778d-4c88-9e17-4c22002c0852 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:36:59.905557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c24fe-778d-4c88-9e17-4c22002c0852 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:36:59.905830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c24fe-778d-4c88-9e17-4c22002c0852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:36:59.933427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1c4c24fe-778d-4c88-9e17-4c22002c0852 None None] MFA Rules not processed for user `90ee002ef8fd45d88f39e420b3006357`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:36:59.934653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1c4c24fe-778d-4c88-9e17-4c22002c0852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:00.005073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1328/2692] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:36:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:00.006495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:00.068824 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d35873-d2a1-436b-a597-a519d31a1d48 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:00.073623 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:00.074171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.074485 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.074796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.075975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:00.078024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:00.114346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1365/2693] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:00 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:00.118383 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c24fe-778d-4c88-9e17-4c22002c0852 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:00.132810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c24fe-778d-4c88-9e17-4c22002c0852 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:00.205249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:00.205865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.206145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.206451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.207080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:00.209036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:00.217969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:00.236634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1329/2694] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:00 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:00.238309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:00.249798 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd8633-b1ac-4257-8c41-d55e53758bf7 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:00.255166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:00.255890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.256159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.256470 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.257208 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:00.258873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:00.270996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1366/2695] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:00.276761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:00.293341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391d4c-e252-471f-959c-45206b321a17 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:00.299304 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:00.299834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.300113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.300414 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] PATH_INFO: `/v3/projects/6d7301c33a794ed38c4fd7c83237e14d/users/6cf6c7970e0447fba37f8a5c0badcbbb/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.318366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7301c33a794ed38c4fd7c83237e14d, user_id=6cf6c7970e0447fba37f8a5c0badcbbb, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:00.321106 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:00.335261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1330/2696] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:00 2022] PUT /identity/v3/projects/6d7301c33a794ed38c4fd7c83237e14d/users/6cf6c7970e0447fba37f8a5c0badcbbb/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:00.339432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:00.351108 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86c47b-6f8b-417d-9854-b52f52151d85 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:00.410818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4cfa-2cc8-4dc1-bf8d-a4f45bb64c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:00.411421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4cfa-2cc8-4dc1-bf8d-a4f45bb64c38 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.411706 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4cfa-2cc8-4dc1-bf8d-a4f45bb64c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.411975 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4cfa-2cc8-4dc1-bf8d-a4f45bb64c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.412645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4cfa-2cc8-4dc1-bf8d-a4f45bb64c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:00.414236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4cfa-2cc8-4dc1-bf8d-a4f45bb64c38 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:00.423820 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1367/2697] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:00.427927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:00.438842 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31416-f768-4791-9937-1d5063cace4d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:00.443514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:00.444181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.444491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.444763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] PATH_INFO: `/v3/projects/6d7301c33a794ed38c4fd7c83237e14d/users/6cf6c7970e0447fba37f8a5c0badcbbb/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.446706 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7301c33a794ed38c4fd7c83237e14d, user_id=6cf6c7970e0447fba37f8a5c0badcbbb, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:00.449360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:00.459912 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1331/2698] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:00 2022] PUT /identity/v3/projects/6d7301c33a794ed38c4fd7c83237e14d/users/6cf6c7970e0447fba37f8a5c0badcbbb/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:00.471145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.471428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.471697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.498966 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] MFA Rules not processed for user `6cf6c7970e0447fba37f8a5c0badcbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:00.500147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:00.544344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:00.569692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1368/2699] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:00.582197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:00.583953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:00.640188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f921-b2b5-4c31-9f8d-a66fc9edb64c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:00.643913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:00.644555 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:00.644834 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:00.645103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:00.699670 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:00.701736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:00.710372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1332/2700] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:02.052788 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:02.054224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:02.066508 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4616f-5c91-4332-a2bb-6d35e650d371 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:02.070008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c90cd-4262-4a99-8773-40c1be3623ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:02.070595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c90cd-4262-4a99-8773-40c1be3623ef service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:02.070874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c90cd-4262-4a99-8773-40c1be3623ef service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:02.071143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c90cd-4262-4a99-8773-40c1be3623ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:02.080552 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c90cd-4262-4a99-8773-40c1be3623ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:02.081977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c90cd-4262-4a99-8773-40c1be3623ef service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:02.091506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1369/2701] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:02.654953 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:02.656450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:02.724150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c3f5c-2789-4306-83d9-717cf1bcdb4c service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:02.728993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:02.729618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:02.729895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:02.730161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] PATH_INFO: `/v3/users/924f781cabe74d22bf25f7578e7034a9` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:02.731302 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924f781cabe74d22bf25f7578e7034a9)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:02.733264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:02.738551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:02.781472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924f781cabe74d22bf25f7578e7034a9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:02.788800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924f781cabe74d22bf25f7578e7034a9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:02.797253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924f781cabe74d22bf25f7578e7034a9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:02.797945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924f781cabe74d22bf25f7578e7034a9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:02.798574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924f781cabe74d22bf25f7578e7034a9'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:02.816048 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1333/2702] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:02 2022] DELETE /identity/v3/users/924f781cabe74d22bf25f7578e7034a9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:02.820504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:02.820807 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:02.821075 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:02.839962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:02.841204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:02.899021 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1370/2703] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:02.908754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:02.910128 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:02.970424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345a171-7421-447e-bcbb-0bf6298e7bd8 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:02.974320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:02.974911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:02.975184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:02.975453 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:02.984209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:02.985657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:02.994759 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1334/2704] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:03.268520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:03.270557 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:03.288911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc43b9-abf5-4147-b17b-2383b1523fb9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:03.293645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:03.294856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:03.295319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:03.295591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] PATH_INFO: `/v3/projects/a1a1492c7da44cf0a55cd4b2ab579b0c` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:03.296885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a1492c7da44cf0a55cd4b2ab579b0c)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:03.298637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:03.346767 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a1492c7da44cf0a55cd4b2ab579b0c', 'request_id': 'req-f764704f-921f-4016-befc-d0f810437615'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.353308 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a1492c7da44cf0a55cd4b2ab579b0c', 'request_id': 'req-f764704f-921f-4016-befc-d0f810437615'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.361656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a1492c7da44cf0a55cd4b2ab579b0c', 'request_id': 'req-f764704f-921f-4016-befc-d0f810437615'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.372648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] The token cache is being invalidate because project a1a1492c7da44cf0a55cd4b2ab579b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:03.372938 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.373561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.375032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1371/2705] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:03 2022] DELETE /identity/v3/projects/a1a1492c7da44cf0a55cd4b2ab579b0c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:03.378976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:03.389181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb987-48d7-46d7-a950-9a515a236dd5 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:03.448750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:03.449379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:03.449659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:03.449925 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] PATH_INFO: `/v3/users/73459776b8ad45e1ae24b30ed5e016d0` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:03.451858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73459776b8ad45e1ae24b30ed5e016d0)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:03.454461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:03.490847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:03.506371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73459776b8ad45e1ae24b30ed5e016d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.513895 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73459776b8ad45e1ae24b30ed5e016d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.522035 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73459776b8ad45e1ae24b30ed5e016d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.522788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73459776b8ad45e1ae24b30ed5e016d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.523402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b64edd63-9cca-4d5e-a779-108878ce8f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73459776b8ad45e1ae24b30ed5e016d0'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.547786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1335/2706] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:03 2022] DELETE /identity/v3/users/73459776b8ad45e1ae24b30ed5e016d0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:03.831109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:03.833275 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:03.846581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764704f-921f-4016-befc-d0f810437615 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:03.897559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:03.908771 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:03.909398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:03.909709 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:03.909969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] PATH_INFO: `/v3/projects/b697b1d18c3740ddb1c3efb8ddaa2828` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:03.911171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b697b1d18c3740ddb1c3efb8ddaa2828)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:03.913101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:03.961597 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b697b1d18c3740ddb1c3efb8ddaa2828', 'request_id': 'req-e89a790b-3300-4591-ba9c-920b6d86359d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.967793 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b697b1d18c3740ddb1c3efb8ddaa2828', 'request_id': 'req-e89a790b-3300-4591-ba9c-920b6d86359d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.977028 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b697b1d18c3740ddb1c3efb8ddaa2828', 'request_id': 'req-e89a790b-3300-4591-ba9c-920b6d86359d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.987922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] The token cache is being invalidate because project b697b1d18c3740ddb1c3efb8ddaa2828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:03.988209 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.988918 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-e89a790b-3300-4591-ba9c-920b6d86359d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:03.990726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1372/2707] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:03 2022] DELETE /identity/v3/projects/b697b1d18c3740ddb1c3efb8ddaa2828 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:03.996420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26851-5bd9-45f3-9fc3-04f2548f96a5 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:03.996921 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26851-5bd9-45f3-9fc3-04f2548f96a5 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:03.997037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26851-5bd9-45f3-9fc3-04f2548f96a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.017554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-bdd26851-5bd9-45f3-9fc3-04f2548f96a5 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:04.018752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-bdd26851-5bd9-45f3-9fc3-04f2548f96a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:04.081801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1336/2708] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:04.089540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6568fb-3656-4737-ba3b-af20c12d8244 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.089821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6568fb-3656-4737-ba3b-af20c12d8244 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.090092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6568fb-3656-4737-ba3b-af20c12d8244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.110033 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-2e6568fb-3656-4737-ba3b-af20c12d8244 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:04.111214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-2e6568fb-3656-4737-ba3b-af20c12d8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:04.118944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1373/2709] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:04.123154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26851-5bd9-45f3-9fc3-04f2548f96a5 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.132997 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26851-5bd9-45f3-9fc3-04f2548f96a5 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.137595 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.138688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.138965 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.139234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.139879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:04.140181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.141807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.153116 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1337/2710] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:04.158078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6568fb-3656-4737-ba3b-af20c12d8244 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.167538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6568fb-3656-4737-ba3b-af20c12d8244 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.172183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.172814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.173094 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.173364 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.174000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.175900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.202421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1374/2711] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:04 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:04.206523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.216919 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836f75-e1cb-4116-9f9a-95b82678cecd admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.272150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.272837 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.273093 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.273364 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.273991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.275947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.296809 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1338/2712] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:04 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:04.300917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.311721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67225-e9bf-4840-91c8-c92873002e62 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.316570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.317178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.317457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.317726 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.318361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.319991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.330286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1375/2713] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:04.334688 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.346349 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e2d88-d1c1-41ef-9d1f-3932cc3f984d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.351342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50119f5b-687e-49f6-9568-2e2a90fd862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.351929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119f5b-687e-49f6-9568-2e2a90fd862d admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.352204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119f5b-687e-49f6-9568-2e2a90fd862d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.352575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119f5b-687e-49f6-9568-2e2a90fd862d admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.353209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50119f5b-687e-49f6-9568-2e2a90fd862d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.354815 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50119f5b-687e-49f6-9568-2e2a90fd862d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.366118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1339/2714] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:04.370221 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.379983 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2db18-e09b-4a5c-8543-72a99125f69d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.384515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.385149 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.385450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.385720 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] PATH_INFO: `/v3/projects/04c0222368254c2e97ccc187f02fedae/users/77b6cca988834194b598c7f46a3172d3/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.399743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c0222368254c2e97ccc187f02fedae, user_id=77b6cca988834194b598c7f46a3172d3, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.402388 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.416162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1376/2715] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:04 2022] PUT /identity/v3/projects/04c0222368254c2e97ccc187f02fedae/users/77b6cca988834194b598c7f46a3172d3/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:04.428113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d093dc-223b-4101-a905-361ffdc351e2 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.428424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d093dc-223b-4101-a905-361ffdc351e2 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.428741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d093dc-223b-4101-a905-361ffdc351e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.453326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:04.456418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e4d093dc-223b-4101-a905-361ffdc351e2 None None] MFA Rules not processed for user `77b6cca988834194b598c7f46a3172d3`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:04.458136 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e4d093dc-223b-4101-a905-361ffdc351e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:04.524228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1340/2716] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:04.528963 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.588923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00742-4d45-4bb6-9d3d-e2defce04200 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.593391 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.593980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.594256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.594530 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.595142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.597058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.623525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1377/2717] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:04 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:04.627510 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d093dc-223b-4101-a905-361ffdc351e2 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.638848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d093dc-223b-4101-a905-361ffdc351e2 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.700938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.701543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.701817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.702084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.702717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.704675 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.730433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1341/2718] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:04 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:04.734372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.739826 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:04.746240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eb08f-005c-45bb-9097-b77882ba07fc admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.752186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.752900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.753255 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.753591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.754476 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.756111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.767977 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1378/2719] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:04.772467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.785661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a7dea-9335-41f7-a0ad-91617e8d32a4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.792785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.793734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.794199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.794664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] PATH_INFO: `/v3/projects/e56dc7a23dd1486b9b78ee41f5f2a30d/users/c6feaea90b494f878415f4973de67410/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.819691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.821990 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:04.825890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56dc7a23dd1486b9b78ee41f5f2a30d, user_id=c6feaea90b494f878415f4973de67410, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.833734 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.838151 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a5b9-3420-4e6b-a268-e741b7a6815a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.844319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.845187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.845187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.845501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] PATH_INFO: `/v3/users/e683d8ac03f34ff8ae235f0d80cc18c7` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.846699 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e683d8ac03f34ff8ae235f0d80cc18c7)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.849005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.850399 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1342/2720] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:04 2022] PUT /identity/v3/projects/e56dc7a23dd1486b9b78ee41f5f2a30d/users/c6feaea90b494f878415f4973de67410/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:04.854372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.906393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e683d8ac03f34ff8ae235f0d80cc18c7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:04.914154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e683d8ac03f34ff8ae235f0d80cc18c7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:04.914861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e683d8ac03f34ff8ae235f0d80cc18c7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:04.922967 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b094a-8993-431d-bc09-193b804123d8 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.923252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e683d8ac03f34ff8ae235f0d80cc18c7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:04.927806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:04.928467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.928898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.929421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.929810 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:04.931516 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:04.939116 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cf173a3d-bd61-43c2-8e26-f439a73b2f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e683d8ac03f34ff8ae235f0d80cc18c7'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:04.943251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1343/2721] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:04.947416 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:04.948095 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1379/2722] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:04 2022] DELETE /identity/v3/users/e683d8ac03f34ff8ae235f0d80cc18c7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:04.949171 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:04.952795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:04.953004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:04.953252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:04.958519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:04.963474 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0b54b-8409-4d4c-9da3-9476a44c18d5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:04.977495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:04.978693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.023216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce0a0a-21ff-4aec-b5c1-4f54d01235e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.023908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce0a0a-21ff-4aec-b5c1-4f54d01235e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.024186 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce0a0a-21ff-4aec-b5c1-4f54d01235e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.024561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce0a0a-21ff-4aec-b5c1-4f54d01235e8 admin admin] PATH_INFO: `/v3/projects/e56dc7a23dd1486b9b78ee41f5f2a30d/users/c6feaea90b494f878415f4973de67410/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.026485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce0a0a-21ff-4aec-b5c1-4f54d01235e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56dc7a23dd1486b9b78ee41f5f2a30d, user_id=c6feaea90b494f878415f4973de67410, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.029195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce0a0a-21ff-4aec-b5c1-4f54d01235e8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.039434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1344/2723] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:04 2022] PUT /identity/v3/projects/e56dc7a23dd1486b9b78ee41f5f2a30d/users/c6feaea90b494f878415f4973de67410/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:05.042150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1380/2724] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:05.049464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.049755 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.050022 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.052024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.053394 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.079636 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] MFA Rules not processed for user `c6feaea90b494f878415f4973de67410`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:05.080865 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.112359 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2752e1-c4ce-4b9b-bb02-d53948fc2e1f None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.128411 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:05.150747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1345/2725] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:05.166105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.166105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.170465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.171276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.171550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.171815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.224401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5fcbb-fa37-4e3c-aced-1710b55e18a3 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.228038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.228673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.228949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.229219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.234147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.235715 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.240927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.242341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.246455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1381/2726] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:05.251936 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1346/2727] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:05.360287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.370332 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196173-9690-486e-a8cf-d78f6bdf5c40 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.373883 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d374de-f93a-4704-8c06-70604aedf60a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.374478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d374de-f93a-4704-8c06-70604aedf60a service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.374754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d374de-f93a-4704-8c06-70604aedf60a service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.375024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d374de-f93a-4704-8c06-70604aedf60a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.376781 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-01d374de-f93a-4704-8c06-70604aedf60a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.439823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d374de-f93a-4704-8c06-70604aedf60a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.441304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d374de-f93a-4704-8c06-70604aedf60a service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.450238 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1382/2728] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:05.548054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.549597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.580429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7088-1995-4524-bb24-f3b3cb8f72e2 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.585070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.585828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.586142 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.586462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] PATH_INFO: `/v3/projects/2701cfc9129947b19d33258f6f99503e` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.587618 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2701cfc9129947b19d33258f6f99503e)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.589565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.615839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:05.641850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2701cfc9129947b19d33258f6f99503e', 'request_id': 'req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:05.648216 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2701cfc9129947b19d33258f6f99503e', 'request_id': 'req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:05.654653 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2701cfc9129947b19d33258f6f99503e', 'request_id': 'req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:05.668419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] The token cache is being invalidate because project 2701cfc9129947b19d33258f6f99503e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:05.669065 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:05.670025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-66801283-f0b3-4b22-a9b3-71b02ef0ee3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:05.672188 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1347/2729] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:05 2022] DELETE /identity/v3/projects/2701cfc9129947b19d33258f6f99503e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:05.677174 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cfd0d-6dd8-418b-bc98-6a084dbb5e54 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.677460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cfd0d-6dd8-418b-bc98-6a084dbb5e54 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.677730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cfd0d-6dd8-418b-bc98-6a084dbb5e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.699628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-604cfd0d-6dd8-418b-bc98-6a084dbb5e54 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:05.701749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-604cfd0d-6dd8-418b-bc98-6a084dbb5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.772561 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1383/2730] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:05.780859 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7411-9425-4b59-8afa-2ea16bd45e3d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.781141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7411-9425-4b59-8afa-2ea16bd45e3d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.781458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7411-9425-4b59-8afa-2ea16bd45e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.801765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-628d7411-9425-4b59-8afa-2ea16bd45e3d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:05.802973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-628d7411-9425-4b59-8afa-2ea16bd45e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.812530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1348/2731] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:05.816843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cfd0d-6dd8-418b-bc98-6a084dbb5e54 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.826980 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cfd0d-6dd8-418b-bc98-6a084dbb5e54 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.831711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.832314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.832629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.832905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.833559 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:05.833926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.835535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.838086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:05.848222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1384/2732] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:05.852460 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7411-9425-4b59-8afa-2ea16bd45e3d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.862190 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7411-9425-4b59-8afa-2ea16bd45e3d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.867419 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.868134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.868323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.868632 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.869276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.871189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.897219 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.898912 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:05.900234 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1349/2733] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:05 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:05.904512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:05.912819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ad00e-936c-4431-85c5-bbcf3377f128 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.973079 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.973716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.973994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.974296 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] PATH_INFO: `/v3/users/90ee002ef8fd45d88f39e420b3006357` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.974651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee8b9e-6a50-42aa-9531-620bb7e1d977 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:05.975500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ee002ef8fd45d88f39e420b3006357)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.977452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:05.980448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:05.981180 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:05.982350 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:05.982664 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:05.983305 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:05.985289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.008144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1350/2734] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:05 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:06.012077 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:06.022579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47b0e-0fc3-4bf6-b15d-a0a3454d5089 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:06.027195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:06.027778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.028036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.028421 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.029057 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:06.029716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ee002ef8fd45d88f39e420b3006357'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.030657 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.038913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ee002ef8fd45d88f39e420b3006357'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.039601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ee002ef8fd45d88f39e420b3006357'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.040676 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1351/2735] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:06.044976 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:06.051090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ee002ef8fd45d88f39e420b3006357'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.055485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8fbed-0b05-439c-84b2-33e100368ed3 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:06.060827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:06.061408 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.061764 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.062043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.062944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:06.064206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-35b33e6f-15c9-4274-ae12-47e8c3f8e130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ee002ef8fd45d88f39e420b3006357'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.064566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.070183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1385/2736] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:05 2022] DELETE /identity/v3/users/90ee002ef8fd45d88f39e420b3006357 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:06.074524 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.074812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.074959 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1352/2737] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:06.075088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.078779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:06.080650 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:06.093102 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357125f-014f-4072-8369-4f8c9a6c2ac9 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:06.093744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:06.094917 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:06.141043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:06.153871 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1386/2738] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:06.157271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:06.157271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.157271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.157271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] PATH_INFO: `/v3/projects/63d99a6bf0f044f09bfc57277b49f3f4/users/09435e9ed47a4e5f9a813bc1359b020b/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.163870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:06.165666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:06.187069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:06.231085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa8ab4-9618-4f65-b650-fab8c880f0ee None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:06.235688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1373a-99ee-4b55-89f1-6ac3f93d5bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:06.236329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1373a-99ee-4b55-89f1-6ac3f93d5bfd service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.236596 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1373a-99ee-4b55-89f1-6ac3f93d5bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.236886 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1373a-99ee-4b55-89f1-6ac3f93d5bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.247220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1373a-99ee-4b55-89f1-6ac3f93d5bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:06.248719 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1373a-99ee-4b55-89f1-6ac3f93d5bfd service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.259489 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1387/2739] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:06.300559 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d99a6bf0f044f09bfc57277b49f3f4, user_id=09435e9ed47a4e5f9a813bc1359b020b, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:06.303192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.316455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1353/2740] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:06 2022] PUT /identity/v3/projects/63d99a6bf0f044f09bfc57277b49f3f4/users/09435e9ed47a4e5f9a813bc1359b020b/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:06.328118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.328507 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.328803 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.357181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] MFA Rules not processed for user `09435e9ed47a4e5f9a813bc1359b020b`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:06.358472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:06.429314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1388/2741] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:06.440465 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:06.442170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:06.500417 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96bf6-9cf8-489f-85e9-6e84ed4a1769 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:06.504231 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:06.504866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.505145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.505415 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.515916 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:06.517393 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.526982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1354/2742] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:06.538649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:06.540446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:06.610739 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f7fa-8921-4ddc-80b7-763d105d8d1d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:06.615448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:06.616143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.616512 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.616857 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] PATH_INFO: `/v3/projects/1ec295b691d44e75b8012dd70a170282` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.617994 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec295b691d44e75b8012dd70a170282)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:06.619893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.670038 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec295b691d44e75b8012dd70a170282', 'request_id': 'req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.671224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:06.678553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec295b691d44e75b8012dd70a170282', 'request_id': 'req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.687428 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec295b691d44e75b8012dd70a170282', 'request_id': 'req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.699861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] The token cache is being invalidate because project 1ec295b691d44e75b8012dd70a170282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:06.700205 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.700894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.702420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1389/2743] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:06 2022] DELETE /identity/v3/projects/1ec295b691d44e75b8012dd70a170282 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:06.706444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:06.718097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb1d2-6ad3-4428-ad0a-107625c7401e service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:06.797893 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:06.798558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:06.798836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:06.799170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] PATH_INFO: `/v3/users/6cf6c7970e0447fba37f8a5c0badcbbb` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:06.800515 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf6c7970e0447fba37f8a5c0badcbbb)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:06.802443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:06.876854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf6c7970e0447fba37f8a5c0badcbbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.884673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf6c7970e0447fba37f8a5c0badcbbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.893084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf6c7970e0447fba37f8a5c0badcbbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.893861 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf6c7970e0447fba37f8a5c0badcbbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.894572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-189f1156-242d-4808-83ae-bde166fecd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf6c7970e0447fba37f8a5c0badcbbb'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:06.906757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:06.918131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1355/2744] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:06 2022] DELETE /identity/v3/users/6cf6c7970e0447fba37f8a5c0badcbbb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:07.217775 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.219186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:07.243672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36d9f1-f4e4-412f-b4f3-3db33a5b18b3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.301948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.302574 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.302851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.303123 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] PATH_INFO: `/v3/projects/6d7301c33a794ed38c4fd7c83237e14d` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.304229 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d7301c33a794ed38c4fd7c83237e14d)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.306158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:07.350153 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d7301c33a794ed38c4fd7c83237e14d', 'request_id': 'req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:07.356062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d7301c33a794ed38c4fd7c83237e14d', 'request_id': 'req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:07.364015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d7301c33a794ed38c4fd7c83237e14d', 'request_id': 'req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:07.374178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] The token cache is being invalidate because project 6d7301c33a794ed38c4fd7c83237e14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:07.374464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:07.375081 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ea3ca3a0-ac67-44d8-ad4b-9864a2dbea5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:07.376579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1390/2745] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:07 2022] DELETE /identity/v3/projects/6d7301c33a794ed38c4fd7c83237e14d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:07.381387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5255d-2fed-4e1b-8e74-b55fcb1c2b22 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.381862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5255d-2fed-4e1b-8e74-b55fcb1c2b22 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.381986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5255d-2fed-4e1b-8e74-b55fcb1c2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.400768 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-1ec5255d-2fed-4e1b-8e74-b55fcb1c2b22 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:07.401947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1ec5255d-2fed-4e1b-8e74-b55fcb1c2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:07.458565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1356/2746] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:07.466180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa0d5-23d0-4544-9b86-ed3483f2692b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.466689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa0d5-23d0-4544-9b86-ed3483f2692b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.466689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa0d5-23d0-4544-9b86-ed3483f2692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.486365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-48efa0d5-23d0-4544-9b86-ed3483f2692b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:07.487569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-48efa0d5-23d0-4544-9b86-ed3483f2692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:07.495685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1391/2747] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:07.500310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5255d-2fed-4e1b-8e74-b55fcb1c2b22 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.509697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5255d-2fed-4e1b-8e74-b55fcb1c2b22 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.514725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.515311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.515582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.515845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.516526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:07.516806 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.518380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:07.530490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1357/2748] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:07.534670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa0d5-23d0-4544-9b86-ed3483f2692b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.544491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa0d5-23d0-4544-9b86-ed3483f2692b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.549147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.549734 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.550013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.550284 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.550947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.552880 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:07.580042 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1392/2749] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:07 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:07.584003 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.593738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3dc9-eefa-4451-8e28-2de8e89ebad4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.649462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.650064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.650344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.650619 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.651248 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.653235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:07.674335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1358/2750] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:07 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:07.678494 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.689421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9527b-307c-41db-89a6-061fd42bdbbe admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.694115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.694700 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.694972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.695263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.695889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.697522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:07.707389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1393/2751] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:07.711129 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.721109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a570c0-c951-4faf-8100-dcb0abf48989 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.725872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713b1b9-6e31-4192-8b52-ddba4ffe66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.726452 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713b1b9-6e31-4192-8b52-ddba4ffe66e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.726730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713b1b9-6e31-4192-8b52-ddba4ffe66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.727002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713b1b9-6e31-4192-8b52-ddba4ffe66e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.727656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713b1b9-6e31-4192-8b52-ddba4ffe66e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.729266 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713b1b9-6e31-4192-8b52-ddba4ffe66e7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:07.739462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1359/2752] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:07.743405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.753850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed56a-3b33-461f-9dd5-b5249ff8127e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.758442 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.759078 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.759358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.759629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] PATH_INFO: `/v3/projects/05e8bb43de9b4640b7c7fb24ce6e18cd/users/2cff788ff23344e4be2fc555bfe37b7d/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.774263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e8bb43de9b4640b7c7fb24ce6e18cd, user_id=2cff788ff23344e4be2fc555bfe37b7d, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.777146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:07.790191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1394/2753] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:07 2022] PUT /identity/v3/projects/05e8bb43de9b4640b7c7fb24ce6e18cd/users/2cff788ff23344e4be2fc555bfe37b7d/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:07.801858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad778a2f-36c3-420c-9dd7-1f12a76d34bd None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.802157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad778a2f-36c3-420c-9dd7-1f12a76d34bd None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.802431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad778a2f-36c3-420c-9dd7-1f12a76d34bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.830403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ad778a2f-36c3-420c-9dd7-1f12a76d34bd None None] MFA Rules not processed for user `2cff788ff23344e4be2fc555bfe37b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:07.831608 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ad778a2f-36c3-420c-9dd7-1f12a76d34bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:07.878832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:07.898058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1360/2754] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:07.902577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:07.918009 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:07.980609 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54807-b5c9-4b41-ac86-f64c3136af82 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:07.985186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:07.985783 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:07.986058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:07.986329 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:07.986964 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:07.988891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.017003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1395/2755] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:07 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:08.021185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad778a2f-36c3-420c-9dd7-1f12a76d34bd None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.032684 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad778a2f-36c3-420c-9dd7-1f12a76d34bd None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.074505 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.082584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.101466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.102268 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.102584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.102898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.103530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.105507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.137179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1361/2756] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:08 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:08.138709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.150403 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c6ff9-50f5-431b-b0dc-75c5d27ea489 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.155856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.156697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.156788 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.157049 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.157699 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.159324 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.163395 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d35f6-ee30-4ddb-9f5f-eede92e0f319 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.168589 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.169879 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.170184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.170454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] PATH_INFO: `/v3/users/77b6cca988834194b598c7f46a3172d3` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.170721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1362/2757] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:08.174823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b6cca988834194b598c7f46a3172d3)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.175051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.176844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.185506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67c1c-3195-4101-a55b-ca678efa65f5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.190335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.190982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.191264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.191686 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] PATH_INFO: `/v3/projects/74a8722e894748098b2807fe0d827a87/users/b652709feece457aaa9d0deb43f9d94b/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.209637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a8722e894748098b2807fe0d827a87, user_id=b652709feece457aaa9d0deb43f9d94b, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.212850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.230132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1363/2758] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:08 2022] PUT /identity/v3/projects/74a8722e894748098b2807fe0d827a87/users/b652709feece457aaa9d0deb43f9d94b/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:08.236986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.241674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b6cca988834194b598c7f46a3172d3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.249399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b6cca988834194b598c7f46a3172d3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.250092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b6cca988834194b598c7f46a3172d3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.258104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b6cca988834194b598c7f46a3172d3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.275204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-32218859-7236-4640-ae64-ec398e00058b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b6cca988834194b598c7f46a3172d3'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.283758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1396/2759] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:08 2022] DELETE /identity/v3/users/77b6cca988834194b598c7f46a3172d3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:08.288449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.288854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.289169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.313188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:08.314471 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.314591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642313-adbf-4016-826b-a74d9e23875e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.318810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:08.376002 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:08.397135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1397/2760] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:08.397135 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.399786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.400343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.400597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.400868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.401644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.403407 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.407469 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.415805 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1364/2761] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:08.420431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.422908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.438124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc150-afca-4272-98b4-b0ac26df431d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.444945 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ca3ee-a0c5-412d-9c73-d0bc7d1531d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.445973 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca3ee-a0c5-412d-9c73-d0bc7d1531d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.446651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca3ee-a0c5-412d-9c73-d0bc7d1531d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.447228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca3ee-a0c5-412d-9c73-d0bc7d1531d5 admin admin] PATH_INFO: `/v3/projects/74a8722e894748098b2807fe0d827a87/users/b652709feece457aaa9d0deb43f9d94b/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.453276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ca3ee-a0c5-412d-9c73-d0bc7d1531d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a8722e894748098b2807fe0d827a87, user_id=b652709feece457aaa9d0deb43f9d94b, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.467640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ca3ee-a0c5-412d-9c73-d0bc7d1531d5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.481779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d12114-1b64-4033-bfad-ca681e95a2fd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.485274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1365/2762] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:08 2022] PUT /identity/v3/projects/74a8722e894748098b2807fe0d827a87/users/b652709feece457aaa9d0deb43f9d94b/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:08.495156 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.495440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.495709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.527174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] MFA Rules not processed for user `b652709feece457aaa9d0deb43f9d94b`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:08.528677 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.541099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.541713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.542046 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.542354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.599656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1366/2763] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:08.608357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.610013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.612469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.613894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.620157 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1398/2764] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:08.677143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e067d-403e-44e0-9770-c753d4fd478c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.681098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bd2e6-57a6-4906-9afd-05941133e3cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.681697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd2e6-57a6-4906-9afd-05941133e3cc service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.681978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd2e6-57a6-4906-9afd-05941133e3cc service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.682244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd2e6-57a6-4906-9afd-05941133e3cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.692935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bd2e6-57a6-4906-9afd-05941133e3cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.695167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bd2e6-57a6-4906-9afd-05941133e3cc service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.706533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1367/2765] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:08.785952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.797241 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae13db-92c2-440c-a8e8-46ba5975bbc3 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.801953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.802578 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.802850 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.803119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] PATH_INFO: `/v3/users/2cff788ff23344e4be2fc555bfe37b7d` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.804243 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cff788ff23344e4be2fc555bfe37b7d)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.806185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.817926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:08.855279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cff788ff23344e4be2fc555bfe37b7d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.862304 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cff788ff23344e4be2fc555bfe37b7d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.862967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cff788ff23344e4be2fc555bfe37b7d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.869943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cff788ff23344e4be2fc555bfe37b7d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.883586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cff788ff23344e4be2fc555bfe37b7d'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:08.890534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1399/2766] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:08 2022] DELETE /identity/v3/users/2cff788ff23344e4be2fc555bfe37b7d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:08.895339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.895750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.896025 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.909158 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:08.910675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.919047 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:08.920264 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:08.982099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec428938-d780-4a88-a7e4-427b994c45f8 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:08.986856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:08.987498 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:08.987844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:08.988254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] PATH_INFO: `/v3/projects/04c0222368254c2e97ccc187f02fedae` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:08.989401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c0222368254c2e97ccc187f02fedae)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:08.991345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:08.992863 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1368/2767] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:09.002935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:09.004613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.009662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:09.039724 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c0222368254c2e97ccc187f02fedae', 'request_id': 'req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.046456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c0222368254c2e97ccc187f02fedae', 'request_id': 'req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.054114 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c0222368254c2e97ccc187f02fedae', 'request_id': 'req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.064629 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072fbb7-7378-4902-8f64-a7e463f68c8b None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:09.065679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] The token cache is being invalidate because project 04c0222368254c2e97ccc187f02fedae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:09.066377 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.067215 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.068758 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1400/2768] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:08 2022] DELETE /identity/v3/projects/04c0222368254c2e97ccc187f02fedae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:09.072897 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:09.074270 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.095162 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:09.115277 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:09.115886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:09.116164 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:09.116478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:09.118261 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.143746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5fae-b1ac-445f-b3d0-d5ae97def8e9 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:09.148445 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:09.149072 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:09.149345 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:09.149612 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] PATH_INFO: `/v3/users/c6feaea90b494f878415f4973de67410` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:09.150756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6feaea90b494f878415f4973de67410)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:09.152692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:09.185766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:09.187341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:09.197179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1369/2769] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:09.199688 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6feaea90b494f878415f4973de67410'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.206970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6feaea90b494f878415f4973de67410'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.207661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6feaea90b494f878415f4973de67410'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.215540 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6feaea90b494f878415f4973de67410'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.228923 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6feaea90b494f878415f4973de67410'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.236797 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1401/2770] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:09 2022] DELETE /identity/v3/users/c6feaea90b494f878415f4973de67410 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:09.603144 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:09.605786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.624434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db2eef-1a1e-4c04-96e1-875988c90264 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:09.679810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:09.683155 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.710303 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:09.711079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:09.711449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:09.711819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] PATH_INFO: `/v3/projects/05e8bb43de9b4640b7c7fb24ce6e18cd` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:09.713211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e8bb43de9b4640b7c7fb24ce6e18cd)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:09.715442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:09.729038 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=100 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:09.768637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917eb72-40f2-4855-8178-769f6c825e6f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:09.781039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e8bb43de9b4640b7c7fb24ce6e18cd', 'request_id': 'req-51356037-4ce1-4255-884b-2691ff271cb8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.787698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e8bb43de9b4640b7c7fb24ce6e18cd', 'request_id': 'req-51356037-4ce1-4255-884b-2691ff271cb8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.793594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e8bb43de9b4640b7c7fb24ce6e18cd', 'request_id': 'req-51356037-4ce1-4255-884b-2691ff271cb8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.806872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] The token cache is being invalidate because project 05e8bb43de9b4640b7c7fb24ce6e18cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:09.807123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.807817 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.809909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1370/2771] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:09 2022] DELETE /identity/v3/projects/05e8bb43de9b4640b7c7fb24ce6e18cd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:09.814131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:09.815726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.816523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:09.835133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:09.836034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:09.836307 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:09.836606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] PATH_INFO: `/v3/projects/e56dc7a23dd1486b9b78ee41f5f2a30d` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:09.837814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56dc7a23dd1486b9b78ee41f5f2a30d)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:09.840106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:09.885210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51356037-4ce1-4255-884b-2691ff271cb8 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:09.887693 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56dc7a23dd1486b9b78ee41f5f2a30d', 'request_id': 'req-d3a6b64a-b01f-48ce-9673-89788a9401ca'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.893861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56dc7a23dd1486b9b78ee41f5f2a30d', 'request_id': 'req-d3a6b64a-b01f-48ce-9673-89788a9401ca'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.901358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56dc7a23dd1486b9b78ee41f5f2a30d', 'request_id': 'req-d3a6b64a-b01f-48ce-9673-89788a9401ca'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.912842 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] The token cache is being invalidate because project e56dc7a23dd1486b9b78ee41f5f2a30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:09.913152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.913755 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d3a6b64a-b01f-48ce-9673-89788a9401ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:09.915230 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1402/2772] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:09 2022] DELETE /identity/v3/projects/e56dc7a23dd1486b9b78ee41f5f2a30d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:09.920661 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8177c-6390-450c-8c77-45e606cb44c6 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:09.920937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8177c-6390-450c-8c77-45e606cb44c6 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:09.921204 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8177c-6390-450c-8c77-45e606cb44c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:09.941023 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-fab8177c-6390-450c-8c77-45e606cb44c6 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:09.941896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:09.942206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-fab8177c-6390-450c-8c77-45e606cb44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.942524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:09.942800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:09.943094 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] PATH_INFO: `/v3/users/b652709feece457aaa9d0deb43f9d94b` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:09.944211 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b652709feece457aaa9d0deb43f9d94b)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:09.946183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:09.950568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1403/2773] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:09.958383 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b9f1-9afe-4349-8397-255ac5b8cd1b None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:09.958730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b9f1-9afe-4349-8397-255ac5b8cd1b None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:09.959008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b9f1-9afe-4349-8397-255ac5b8cd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:09.978586 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3ac5b9f1-9afe-4349-8397-255ac5b8cd1b None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:09.979799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3ac5b9f1-9afe-4349-8397-255ac5b8cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:09.987863 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1404/2774] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:09.992001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5b9f1-9afe-4349-8397-255ac5b8cd1b None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.000351 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b652709feece457aaa9d0deb43f9d94b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.001001 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5b9f1-9afe-4349-8397-255ac5b8cd1b None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.001578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:10.006592 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.007175 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.007572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.007852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.008526 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:10.008812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.009947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b652709feece457aaa9d0deb43f9d94b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.010403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.017827 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b652709feece457aaa9d0deb43f9d94b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.018461 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b652709feece457aaa9d0deb43f9d94b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.019157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b652709feece457aaa9d0deb43f9d94b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.024757 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1405/2775] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:37:10.029460 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.031109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:10.037765 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1371/2776] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:09 2022] DELETE /identity/v3/users/b652709feece457aaa9d0deb43f9d94b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:10.043466 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f04cc-dc05-4b5e-8fa8-eab4c841c8b6 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.101895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.102791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.102791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.103104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.103685 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.105644 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.133741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1406/2777] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:10.138524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.149193 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7732e6-c1d1-4b7b-a25d-6326b6738d5c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.211524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.212135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.212444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.212718 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.213374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.215288 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.243376 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1372/2778] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:10.244925 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.255637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fb673-9cb3-414b-8a79-492b5291102e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.260545 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.261143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.261405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.261670 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.262299 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.263992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.275225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1407/2779] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:10.279149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.289935 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701a0a-6ee2-4a43-ba3a-11d37977ab25 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.294946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.295239 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.295518 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.295785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.296444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.298055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.312054 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1373/2780] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:10.316274 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.320640 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.323571 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:10.327818 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c6ff-b060-45e9-ba3e-47d237c1c046 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.332799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669f6c7-3a80-4625-af5d-7c871fb30b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.333450 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f6c7-3a80-4625-af5d-7c871fb30b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.333742 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f6c7-3a80-4625-af5d-7c871fb30b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.333996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f6c7-3a80-4625-af5d-7c871fb30b6d admin admin] PATH_INFO: `/v3/projects/111a00f004654c69bf6d972270902335/users/a6c99e84c9d44007b9158b3afb365f85/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.337949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d73a-7bf3-4566-9d35-d959b80deb3f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.343282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.343917 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.344281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.344587 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] PATH_INFO: `/v3/projects/74a8722e894748098b2807fe0d827a87` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.345854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a8722e894748098b2807fe0d827a87)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.348168 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.351465 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669f6c7-3a80-4625-af5d-7c871fb30b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=111a00f004654c69bf6d972270902335, user_id=a6c99e84c9d44007b9158b3afb365f85, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.354689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669f6c7-3a80-4625-af5d-7c871fb30b6d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.363444 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:10.370297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1408/2781] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:10 2022] PUT /identity/v3/projects/111a00f004654c69bf6d972270902335/users/a6c99e84c9d44007b9158b3afb365f85/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:10.382240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.382532 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.382993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.399281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a8722e894748098b2807fe0d827a87', 'request_id': 'req-06efadf3-4279-47c0-9082-f965f68b0e83'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.405941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a8722e894748098b2807fe0d827a87', 'request_id': 'req-06efadf3-4279-47c0-9082-f965f68b0e83'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.410809 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] MFA Rules not processed for user `a6c99e84c9d44007b9158b3afb365f85`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:10.411580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a8722e894748098b2807fe0d827a87', 'request_id': 'req-06efadf3-4279-47c0-9082-f965f68b0e83'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.412159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:10.423579 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] The token cache is being invalidate because project 74a8722e894748098b2807fe0d827a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:10.423890 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.424547 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-06efadf3-4279-47c0-9082-f965f68b0e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:10.426039 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1374/2782] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:10 2022] DELETE /identity/v3/projects/74a8722e894748098b2807fe0d827a87 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:10.430637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810e9f-d13b-4b4a-b8b7-86abfd33b245 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.430908 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810e9f-d13b-4b4a-b8b7-86abfd33b245 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.431178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810e9f-d13b-4b4a-b8b7-86abfd33b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.450867 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2f810e9f-d13b-4b4a-b8b7-86abfd33b245 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:10.452051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2f810e9f-d13b-4b4a-b8b7-86abfd33b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:10.473628 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:10.479743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1409/2783] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:10.484782 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.486150 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:10.516993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1375/2784] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:10.525181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3ebd-e7c8-48d7-9e6a-87ceb3eb406c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.525638 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3ebd-e7c8-48d7-9e6a-87ceb3eb406c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.525944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3ebd-e7c8-48d7-9e6a-87ceb3eb406c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.545489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-4cee3ebd-e7c8-48d7-9e6a-87ceb3eb406c None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:10.546671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4cee3ebd-e7c8-48d7-9e6a-87ceb3eb406c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:10.554410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1376/2785] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:10.558528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3ebd-e7c8-48d7-9e6a-87ceb3eb406c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.559649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036f73a-775e-415a-8f0c-d176212e6977 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.564472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.565082 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.565366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.565640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.566297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.567521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3ebd-e7c8-48d7-9e6a-87ceb3eb406c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.568231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.572045 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.572762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.572915 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.573181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.573820 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:10.574141 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.576210 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.588625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1377/2786] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 00:37:10.593558 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.597127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1410/2787] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:10.601105 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.606469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6fdf-c03f-46bf-9fe7-91156aa402ae admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.662159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.662857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.663134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.663430 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.663801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4496a9f-d21a-4354-a5af-61c237f516ec admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.664072 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.666051 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.668501 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.669640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.669949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.670223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.670846 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.672776 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.696443 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1378/2788] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:10.696673 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1411/2789] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:10.697568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.697902 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.703239 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:10.708825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47581899-b4bd-4aa9-87b9-2b85d7c7f253 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.765991 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d025-1eff-4496-813b-ad1fb14785c5 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.770969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.771575 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.771864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.772137 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.772807 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.773066 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.773695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.773979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.774266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.774715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.774892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.776572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.789067 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1412/2790] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:10.793370 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.800433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1379/2791] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:10.800662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.805276 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655de13-6864-4a0e-954b-debaa27456b3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.811163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8984-0327-4d53-9599-a32da431add6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.813455 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.814341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.814830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.815314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.815962 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.817121 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.818149 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.818716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.819062 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.819780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.820297 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.821798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.832289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1380/2792] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:10.833643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1413/2793] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:10.837493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.840034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.848843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7272e-0ba3-40a0-b7ab-003db70e461b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.853830 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.854429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.854705 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.854889 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d34c-3513-40cf-9222-cd882218cf82 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.855016 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.855646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.857752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.861119 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de4736-0530-49d4-852c-da61dc6f67f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.862197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de4736-0530-49d4-852c-da61dc6f67f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.862785 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de4736-0530-49d4-852c-da61dc6f67f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.863278 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:10.863491 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de4736-0530-49d4-852c-da61dc6f67f7 admin admin] PATH_INFO: `/v3/projects/87e1db50bcae43088f21fab4cf98c27d/users/8469478362d44e0e987ec8ab25501cef/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.869387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1381/2794] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:10.876493 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:10.884368 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de4736-0530-49d4-852c-da61dc6f67f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e1db50bcae43088f21fab4cf98c27d, user_id=8469478362d44e0e987ec8ab25501cef, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.887232 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de4736-0530-49d4-852c-da61dc6f67f7 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.892289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e38cff-f8b9-4548-95b4-16bde5a5b9d0 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:10.897371 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4e4b3-0180-43a9-8fb6-a624daf076a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:10.898030 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e4b3-0180-43a9-8fb6-a624daf076a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.898311 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e4b3-0180-43a9-8fb6-a624daf076a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.898584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e4b3-0180-43a9-8fb6-a624daf076a1 admin admin] PATH_INFO: `/v3/projects/577bc71f2a5c4513ba3bab82c7aeb3e1/users/c86fdc604d5f4be5b6a561f794999765/roles/42931b58092d490eb3e62614a2778775` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.901678 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1414/2795] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:10 2022] PUT /identity/v3/projects/87e1db50bcae43088f21fab4cf98c27d/users/8469478362d44e0e987ec8ab25501cef/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:10.913277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb29cf-0c10-409f-a008-5abba3cf48ea None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.913564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb29cf-0c10-409f-a008-5abba3cf48ea None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.913870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb29cf-0c10-409f-a008-5abba3cf48ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.915050 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4e4b3-0180-43a9-8fb6-a624daf076a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577bc71f2a5c4513ba3bab82c7aeb3e1, user_id=c86fdc604d5f4be5b6a561f794999765, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:10.918672 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4e4b3-0180-43a9-8fb6-a624daf076a1 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:10.933110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1382/2796] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:10 2022] PUT /identity/v3/projects/577bc71f2a5c4513ba3bab82c7aeb3e1/users/c86fdc604d5f4be5b6a561f794999765/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:10.945753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd662a4f-3326-40a0-8586-e981cd1adbd6 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:10.945960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-4aeb29cf-0c10-409f-a008-5abba3cf48ea None None] MFA Rules not processed for user `8469478362d44e0e987ec8ab25501cef`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:10.946088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd662a4f-3326-40a0-8586-e981cd1adbd6 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:10.946472 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd662a4f-3326-40a0-8586-e981cd1adbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:10.947015 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4aeb29cf-0c10-409f-a008-5abba3cf48ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:10.976740 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-cd662a4f-3326-40a0-8586-e981cd1adbd6 None None] MFA Rules not processed for user `c86fdc604d5f4be5b6a561f794999765`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:10.978372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-cd662a4f-3326-40a0-8586-e981cd1adbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:11.018622 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1415/2797] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:11.022823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb29cf-0c10-409f-a008-5abba3cf48ea None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.048400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1383/2798] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:11.052570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd662a4f-3326-40a0-8586-e981cd1adbd6 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.077172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:11.091104 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb29cf-0c10-409f-a008-5abba3cf48ea None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.096011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.096645 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.096926 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.097202 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.098113 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.100008 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.114901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd662a4f-3326-40a0-8586-e981cd1adbd6 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.120333 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.121015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.121295 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.121565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.122730 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.124661 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.128712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1416/2799] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:11 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:11.133321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.157501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1384/2800] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:11 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:11.161715 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.198603 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36033-20fe-47e7-b7c4-ba1dc6f375a3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.214743 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:11.228340 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7c62-e15b-4e15-b6d8-98f9045436b4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.234574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.235335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.235668 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.236068 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.236957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.239071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.260538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.260747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1385/2801] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:11 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:11.261437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.261718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.261991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] PATH_INFO: `/v3/users` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.263110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.265168 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.265297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.275097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5523f7-a53b-4e17-a27c-78f703474241 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.281208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.281803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.282080 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.282357 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.282992 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.284700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.287049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1417/2802] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:11 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:11.290911 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.298580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1386/2803] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:11.299506 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.301062 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68dfd0-4e61-46c5-bb71-d18f9fdd282e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.305550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.306127 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.306402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.306669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.307301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.309068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.309192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1d3e-6c02-4a9f-b76a-01a472296f7d admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.314597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.315342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.315623 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.315894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] PATH_INFO: `/v3/projects/cf2c5ab7fee04c5ea436db8aa088a4ea/users/eb3d377dc57d4004938693b0503f859b/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.322400 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1418/2804] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:11.323371 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.331667 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2c5ab7fee04c5ea436db8aa088a4ea, user_id=eb3d377dc57d4004938693b0503f859b, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.333166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db58a-eaf7-471a-b768-f277c47d8da3 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.334315 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.337913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.338851 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.339326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.339679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] PATH_INFO: `/v3/projects/7cb1736dc61d47b685bcb6192018b20e/users/462c1e6671824281a79e061a7c622ec3/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.349427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1387/2805] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:11 2022] PUT /identity/v3/projects/cf2c5ab7fee04c5ea436db8aa088a4ea/users/eb3d377dc57d4004938693b0503f859b/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:11.353644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.355448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb1736dc61d47b685bcb6192018b20e, user_id=462c1e6671824281a79e061a7c622ec3, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.358680 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.372334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1419/2806] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:11 2022] PUT /identity/v3/projects/7cb1736dc61d47b685bcb6192018b20e/users/462c1e6671824281a79e061a7c622ec3/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:11.376576 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.418488 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:11.420020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25038-e831-42e8-be7d-df438f498eb6 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.440618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07628f10-1f69-4a93-a589-6731a45ea5b6 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.445986 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.447035 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.447518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.447987 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.449206 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.451188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.461365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1420/2807] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:11.465351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.475068 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa40897-23af-4250-b21c-68cba4ec6133 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.476738 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.477366 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.477627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.477901 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.478556 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.479681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb3b77-6a57-4694-b4be-fda06febc0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.480163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.480310 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3b77-6a57-4694-b4be-fda06febc0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.480619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3b77-6a57-4694-b4be-fda06febc0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.480891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3b77-6a57-4694-b4be-fda06febc0bb admin admin] PATH_INFO: `/v3/projects/7cb1736dc61d47b685bcb6192018b20e/users/462c1e6671824281a79e061a7c622ec3/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.483337 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb3b77-6a57-4694-b4be-fda06febc0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb1736dc61d47b685bcb6192018b20e, user_id=462c1e6671824281a79e061a7c622ec3, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.485989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb3b77-6a57-4694-b4be-fda06febc0bb admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.490484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1388/2808] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:11.494707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.499432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1421/2809] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:11 2022] PUT /identity/v3/projects/7cb1736dc61d47b685bcb6192018b20e/users/462c1e6671824281a79e061a7c622ec3/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:11.505060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c472d-40c0-494f-b3cc-d9238c641119 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.510905 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.511188 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.511468 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.539011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] MFA Rules not processed for user `462c1e6671824281a79e061a7c622ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:11.540225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:11.551627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:11.565410 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84439a0e-e28e-431b-a442-b559316d6b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.566064 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84439a0e-e28e-431b-a442-b559316d6b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.566343 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84439a0e-e28e-431b-a442-b559316d6b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.566613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84439a0e-e28e-431b-a442-b559316d6b6c admin admin] PATH_INFO: `/v3/projects/cf2c5ab7fee04c5ea436db8aa088a4ea/users/eb3d377dc57d4004938693b0503f859b/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.568701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84439a0e-e28e-431b-a442-b559316d6b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2c5ab7fee04c5ea436db8aa088a4ea, user_id=eb3d377dc57d4004938693b0503f859b, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.571360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84439a0e-e28e-431b-a442-b559316d6b6c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.581449 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1389/2810] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:11 2022] PUT /identity/v3/projects/cf2c5ab7fee04c5ea436db8aa088a4ea/users/eb3d377dc57d4004938693b0503f859b/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:11.591958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.592244 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.592564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.613581 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1422/2811] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:11.626405 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] MFA Rules not processed for user `eb3d377dc57d4004938693b0503f859b`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:11.627681 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.627804 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:11.630659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:11.690676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc12ed-0b6e-4382-a7ff-74cd70bd30e9 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.697345 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1390/2812] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:11.708269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:11.709656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:11.740922 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a3fe-1928-4820-b646-1d2431e9fc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.741538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a3fe-1928-4820-b646-1d2431e9fc52 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.741816 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a3fe-1928-4820-b646-1d2431e9fc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.742088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a3fe-1928-4820-b646-1d2431e9fc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.758385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:11.767098 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b58e9-fabb-4bf9-b577-65c257e7817c None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:11.770841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:11.771446 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:11.771722 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:11.771993 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:11.782428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.783864 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.794341 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1391/2813] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:11.805630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279a3fe-1928-4820-b646-1d2431e9fc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:11.807101 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279a3fe-1928-4820-b646-1d2431e9fc52 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:11.817010 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1423/2814] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:12.100073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:12.199609 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a99e4-c2b4-4fdd-a182-f747d1ea5511 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:12.204821 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:12.205445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:12.205751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:12.206037 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] PATH_INFO: `/v3/users/c86fdc604d5f4be5b6a561f794999765` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:12.207270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86fdc604d5f4be5b6a561f794999765)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:12.209434 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:12.224132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:12.271254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86fdc604d5f4be5b6a561f794999765'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.279431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86fdc604d5f4be5b6a561f794999765'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.286854 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86fdc604d5f4be5b6a561f794999765'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.287968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86fdc604d5f4be5b6a561f794999765'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.288576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86fdc604d5f4be5b6a561f794999765'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.305580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1392/2815] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:12 2022] DELETE /identity/v3/users/c86fdc604d5f4be5b6a561f794999765 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:12.311093 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:12.311316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:12.311587 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:12.330705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:12.331888 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:12.390145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1424/2816] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:12.399753 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:12.401228 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:12.459721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6288ee-0a9b-4274-944a-10486f9ac32e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:12.464536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:12.465858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:12.466221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:12.466594 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:12.476252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:12.477700 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:12.489154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1393/2817] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:12.750547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:12.752830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:12.769906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b6cb7-ab41-4e73-b622-6e8df1dce103 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:12.774510 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:12.775145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:12.775422 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:12.775821 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] PATH_INFO: `/v3/projects/577bc71f2a5c4513ba3bab82c7aeb3e1` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:12.777084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577bc71f2a5c4513ba3bab82c7aeb3e1)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:12.779109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:12.826032 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577bc71f2a5c4513ba3bab82c7aeb3e1', 'request_id': 'req-95efa326-f101-470f-ad11-7a1d86fb8d09'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.832252 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577bc71f2a5c4513ba3bab82c7aeb3e1', 'request_id': 'req-95efa326-f101-470f-ad11-7a1d86fb8d09'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.839690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577bc71f2a5c4513ba3bab82c7aeb3e1', 'request_id': 'req-95efa326-f101-470f-ad11-7a1d86fb8d09'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.850351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] The token cache is being invalidate because project 577bc71f2a5c4513ba3bab82c7aeb3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:12.850638 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.851303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.852814 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1425/2818] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:12 2022] DELETE /identity/v3/projects/577bc71f2a5c4513ba3bab82c7aeb3e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:12.857391 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:12.866998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc5e2-6db1-463f-838f-dc83dfbeb99c service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:12.926123 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:12.926741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:12.927015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:12.927279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] PATH_INFO: `/v3/users/eb3d377dc57d4004938693b0503f859b` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:12.928374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3d377dc57d4004938693b0503f859b)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:12.930294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:12.966119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:12.977004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3d377dc57d4004938693b0503f859b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.984165 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3d377dc57d4004938693b0503f859b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.991455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3d377dc57d4004938693b0503f859b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.992081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3d377dc57d4004938693b0503f859b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:12.992689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3d377dc57d4004938693b0503f859b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:13.010015 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1394/2819] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:12 2022] DELETE /identity/v3/users/eb3d377dc57d4004938693b0503f859b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:13.284090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.285956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:13.299566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa326-f101-470f-ad11-7a1d86fb8d09 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.350462 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:13.370972 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.372256 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.372659 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.373048 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] PATH_INFO: `/v3/projects/cf2c5ab7fee04c5ea436db8aa088a4ea` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.374599 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2c5ab7fee04c5ea436db8aa088a4ea)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.376627 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.386514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.388758 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:13.427979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2c5ab7fee04c5ea436db8aa088a4ea', 'request_id': 'req-cc219c3a-6bc3-4290-a982-ba62aa100d83'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:13.434566 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2c5ab7fee04c5ea436db8aa088a4ea', 'request_id': 'req-cc219c3a-6bc3-4290-a982-ba62aa100d83'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:13.443358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2c5ab7fee04c5ea436db8aa088a4ea', 'request_id': 'req-cc219c3a-6bc3-4290-a982-ba62aa100d83'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:13.455741 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e51b-0c96-4587-a0af-823114791575 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.456515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] The token cache is being invalidate because project cf2c5ab7fee04c5ea436db8aa088a4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:13.456907 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:13.457687 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-cc219c3a-6bc3-4290-a982-ba62aa100d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:13.460372 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1426/2820] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:13 2022] DELETE /identity/v3/projects/cf2c5ab7fee04c5ea436db8aa088a4ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:13.465556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98c0c4-72c9-4962-94c4-189cdb1fe803 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.465974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98c0c4-72c9-4962-94c4-189cdb1fe803 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.466328 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98c0c4-72c9-4962-94c4-189cdb1fe803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.486698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-6a98c0c4-72c9-4962-94c4-189cdb1fe803 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:13.487945 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-6a98c0c4-72c9-4962-94c4-189cdb1fe803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:13.514173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.515095 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.515372 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.515639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.520779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:13.573363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1427/2821] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:13.581567 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502ef12-96de-4b23-8982-5157b5c5471f None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.581878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502ef12-96de-4b23-8982-5157b5c5471f None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.583493 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502ef12-96de-4b23-8982-5157b5c5471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.588199 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.589786 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.600635 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1395/2822] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:13.610904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e502ef12-96de-4b23-8982-5157b5c5471f None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:13.612575 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e502ef12-96de-4b23-8982-5157b5c5471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:13.634744 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1428/2823] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:13.636486 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.648404 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897d129-b8b3-4772-903b-99dae9c06316 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.653876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.653876 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.654158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.654429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.655329 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:13.655733 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.658554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.679150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1396/2824] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:13.681214 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502ef12-96de-4b23-8982-5157b5c5471f None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.695227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502ef12-96de-4b23-8982-5157b5c5471f None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.701041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.703013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.703294 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.704303 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.704974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.707319 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.739584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1429/2825] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:13 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:13.744712 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.755267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce518a-ea22-44dc-9c05-84010bfb2e41 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.760532 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:13.815880 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.816543 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.816944 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.817226 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.817850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.819793 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.844338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1397/2826] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:13 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:13.849669 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.860780 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cca3d-6993-4eb9-b861-cb9dc652fd3b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.866560 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.867172 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.867451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.867721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.868363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.869996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.880463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1430/2827] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:13.884886 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.895748 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f1a1a-db79-460f-a1c6-b74c3887c172 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.901875 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde0084-17b2-4513-8e38-380136624936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.902624 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0084-17b2-4513-8e38-380136624936 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.902957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0084-17b2-4513-8e38-380136624936 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.903721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0084-17b2-4513-8e38-380136624936 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.904478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde0084-17b2-4513-8e38-380136624936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.906083 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde0084-17b2-4513-8e38-380136624936 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.919253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1398/2828] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:13.923542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:13.933577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874bf1-ab81-4d08-bc70-af1f0d6a2676 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:13.940352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:13.941254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.941960 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.942246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] PATH_INFO: `/v3/projects/5ca78c2802454cd1aee10c2b0a183ced/users/e3e76fb4e82f49b4a9d0f8dfd990b983/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:13.960534 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca78c2802454cd1aee10c2b0a183ced, user_id=e3e76fb4e82f49b4a9d0f8dfd990b983, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:13.963267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:13.977111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1431/2829] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:13 2022] PUT /identity/v3/projects/5ca78c2802454cd1aee10c2b0a183ced/users/e3e76fb4e82f49b4a9d0f8dfd990b983/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:13.989091 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6cb9-f3bb-4fca-8e74-76d54e9d33ef None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:13.989455 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6cb9-f3bb-4fca-8e74-76d54e9d33ef None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:13.989795 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6cb9-f3bb-4fca-8e74-76d54e9d33ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.018522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0fbb6cb9-f3bb-4fca-8e74-76d54e9d33ef None None] MFA Rules not processed for user `e3e76fb4e82f49b4a9d0f8dfd990b983`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:14.019823 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0fbb6cb9-f3bb-4fca-8e74-76d54e9d33ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:14.088613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1399/2830] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:14.093169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.103475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:14.165606 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1902f-f03f-44b3-be30-7f3a2ec7bc62 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.170311 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.170909 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.171191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.171461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.172183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.174099 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.207944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1432/2831] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:14 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:14.211927 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb6cb9-f3bb-4fca-8e74-76d54e9d33ef None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.213698 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.215313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:14.223477 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb6cb9-f3bb-4fca-8e74-76d54e9d33ef None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.279315 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ee37-cb29-4d33-8fa1-602b6df69c89 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.283037 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.283639 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.283915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.284185 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.285941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:14.286561 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.287169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.287448 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.287720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.288342 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.290381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.313212 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1400/2832] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:14 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:14.317081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.326539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9acb-0917-48c9-9bfa-4f42b6b506e2 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.331269 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.332097 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.332252 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.332468 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.333125 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.334697 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.336429 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:14.351673 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1401/2833] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 00:37:14.352547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.352771 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.354133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.363185 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54b6a5-efe4-4016-8892-d9baddd0d14c admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.364511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1433/2834] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:14.368169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.368776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.369056 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.370071 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] PATH_INFO: `/v3/projects/6189295cec2f469f8d13daa50befe90b/users/690399e4b7bb48568a1aaa62a21bafe3/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.385177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6189295cec2f469f8d13daa50befe90b, user_id=690399e4b7bb48568a1aaa62a21bafe3, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.387800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.400826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1402/2835] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:14 2022] PUT /identity/v3/projects/6189295cec2f469f8d13daa50befe90b/users/690399e4b7bb48568a1aaa62a21bafe3/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:14.405218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.421196 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35a654-e6f0-42db-b306-e5c12400fe43 service cinder] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.465542 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:14.482996 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67322a58-5618-4e2d-a050-34bd391e02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.483613 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322a58-5618-4e2d-a050-34bd391e02ce admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.483894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322a58-5618-4e2d-a050-34bd391e02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.484165 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322a58-5618-4e2d-a050-34bd391e02ce admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.484837 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67322a58-5618-4e2d-a050-34bd391e02ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.486484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67322a58-5618-4e2d-a050-34bd391e02ce admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.496049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1434/2836] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:14.500911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.511570 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da3ac-173d-4c5d-aaa0-874a7fadcc58 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.516868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.517524 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.517800 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.518066 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] PATH_INFO: `/v3/projects/6189295cec2f469f8d13daa50befe90b/users/690399e4b7bb48568a1aaa62a21bafe3/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.520036 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6189295cec2f469f8d13daa50befe90b, user_id=690399e4b7bb48568a1aaa62a21bafe3, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.526200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.534134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1403/2837] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:14 2022] PUT /identity/v3/projects/6189295cec2f469f8d13daa50befe90b/users/690399e4b7bb48568a1aaa62a21bafe3/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:14.550629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc0df-9d0e-4fae-8923-7e26470a826e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.550915 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc0df-9d0e-4fae-8923-7e26470a826e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.551190 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc0df-9d0e-4fae-8923-7e26470a826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.579352 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-69dfc0df-9d0e-4fae-8923-7e26470a826e None None] MFA Rules not processed for user `690399e4b7bb48568a1aaa62a21bafe3`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:14.580580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-69dfc0df-9d0e-4fae-8923-7e26470a826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:14.648139 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1435/2838] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:14.659957 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.716659 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5fc64-baec-45dc-9f39-6877ad7bbcbe admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.720574 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.721178 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.721458 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.721726 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.731784 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.733276 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.742934 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1404/2839] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:14.814302 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc0df-9d0e-4fae-8923-7e26470a826e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:14.824856 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc0df-9d0e-4fae-8923-7e26470a826e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:14.828741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4f37-7205-4a85-be30-aa994fc2bf4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:14.829346 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4f37-7205-4a85-be30-aa994fc2bf4e service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:14.829628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4f37-7205-4a85-be30-aa994fc2bf4e service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:14.829899 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4f37-7205-4a85-be30-aa994fc2bf4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:14.889074 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4f37-7205-4a85-be30-aa994fc2bf4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:14.890503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4f37-7205-4a85-be30-aa994fc2bf4e service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:14.899874 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1436/2840] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:15.178798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:15.259219 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc5106-f4e7-4a67-88c5-b10d60d585b3 service cinder] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:15.264043 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:15.264801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:15.265146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:15.265483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] PATH_INFO: `/v3/users/e3e76fb4e82f49b4a9d0f8dfd990b983` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:15.266796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e76fb4e82f49b4a9d0f8dfd990b983)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:15.268847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:15.314762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e76fb4e82f49b4a9d0f8dfd990b983'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.321707 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e76fb4e82f49b4a9d0f8dfd990b983'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.328752 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e76fb4e82f49b4a9d0f8dfd990b983'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.329337 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e76fb4e82f49b4a9d0f8dfd990b983'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.329939 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e76fb4e82f49b4a9d0f8dfd990b983'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.331069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:15.349564 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1405/2841] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:15 2022] DELETE /identity/v3/users/e3e76fb4e82f49b4a9d0f8dfd990b983 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:15.354076 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:15.354358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:15.354629 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:15.374385 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:15.375563 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:15.435672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1437/2842] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:15.446170 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:15.447557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:15.505537 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc84b7-fdc5-480d-8b02-bcf72c9b03a4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:15.509166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:15.510070 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:15.510348 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:15.510615 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:15.522173 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:15.523651 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:15.533548 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1406/2843] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:15.819903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:15.821779 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:15.830930 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=100 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:15.834841 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827cbbf-f6f2-415a-8cd3-2c6656e04f46 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:15.839796 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:15.841087 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:15.841366 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:15.841637 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] PATH_INFO: `/v3/projects/5ca78c2802454cd1aee10c2b0a183ced` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:15.842749 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca78c2802454cd1aee10c2b0a183ced)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:15.844672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:15.890867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca78c2802454cd1aee10c2b0a183ced', 'request_id': 'req-1d6663cf-8291-4678-b49f-64b2bd770a44'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.896799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca78c2802454cd1aee10c2b0a183ced', 'request_id': 'req-1d6663cf-8291-4678-b49f-64b2bd770a44'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.904690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca78c2802454cd1aee10c2b0a183ced', 'request_id': 'req-1d6663cf-8291-4678-b49f-64b2bd770a44'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.915000 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] The token cache is being invalidate because project 5ca78c2802454cd1aee10c2b0a183ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:15.915287 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.915903 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:15.917410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1438/2844] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:15 2022] DELETE /identity/v3/projects/5ca78c2802454cd1aee10c2b0a183ced => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:15.921501 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:15.930802 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3d25e-06d4-49e2-b65f-2d8f9a98bcff service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:15.987894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:15.988487 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:15.988754 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:15.989055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] PATH_INFO: `/v3/users/690399e4b7bb48568a1aaa62a21bafe3` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:15.990281 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690399e4b7bb48568a1aaa62a21bafe3)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:15.992344 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.036163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690399e4b7bb48568a1aaa62a21bafe3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.043143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690399e4b7bb48568a1aaa62a21bafe3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.050334 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690399e4b7bb48568a1aaa62a21bafe3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.050958 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690399e4b7bb48568a1aaa62a21bafe3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.051560 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-750dbe48-10d2-4525-be86-aec01c23bc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690399e4b7bb48568a1aaa62a21bafe3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.069236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1407/2845] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:15 2022] DELETE /identity/v3/users/690399e4b7bb48568a1aaa62a21bafe3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:16.341810 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:16.343496 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:16.360658 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6663cf-8291-4678-b49f-64b2bd770a44 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:16.425913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:16.426550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.426831 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.427112 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] PATH_INFO: `/v3/projects/6189295cec2f469f8d13daa50befe90b` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.428240 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6189295cec2f469f8d13daa50befe90b)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:16.430178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.477452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6189295cec2f469f8d13daa50befe90b', 'request_id': 'req-f479686c-74d0-483f-91b9-4b4af0ec58b1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.483624 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6189295cec2f469f8d13daa50befe90b', 'request_id': 'req-f479686c-74d0-483f-91b9-4b4af0ec58b1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.490759 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6189295cec2f469f8d13daa50befe90b', 'request_id': 'req-f479686c-74d0-483f-91b9-4b4af0ec58b1'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.502061 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] The token cache is being invalidate because project 6189295cec2f469f8d13daa50befe90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:16.502374 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.503194 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-f479686c-74d0-483f-91b9-4b4af0ec58b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:16.505090 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1439/2846] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:16 2022] DELETE /identity/v3/projects/6189295cec2f469f8d13daa50befe90b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:16.510352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aef0fe-a37b-420c-a95b-754356c22e94 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.510833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aef0fe-a37b-420c-a95b-754356c22e94 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.510923 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aef0fe-a37b-420c-a95b-754356c22e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.520114 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:16.535785 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-d7aef0fe-a37b-420c-a95b-754356c22e94 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:16.537020 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-d7aef0fe-a37b-420c-a95b-754356c22e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:16.600122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1408/2847] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:16.609326 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084127-d53f-4989-809f-f90e8d1b0533 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.609611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084127-d53f-4989-809f-f90e8d1b0533 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.609892 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084127-d53f-4989-809f-f90e8d1b0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.629819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-12084127-d53f-4989-809f-f90e8d1b0533 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:16.631016 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-12084127-d53f-4989-809f-f90e8d1b0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:16.638853 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1440/2848] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:16.645360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aef0fe-a37b-420c-a95b-754356c22e94 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:16.655184 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aef0fe-a37b-420c-a95b-754356c22e94 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:16.659713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:16.660325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.660644 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.660909 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.661551 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:16.661845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:16.663418 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.675639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1409/2849] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:16.680225 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12084127-d53f-4989-809f-f90e8d1b0533 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:16.690474 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12084127-d53f-4989-809f-f90e8d1b0533 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:16.695171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:16.695766 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.696049 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.696334 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.696970 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:16.698893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.708572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:16.730535 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1441/2850] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:16 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:16.735221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:16.745283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4bf25-dbd2-4aef-aa8a-ae5c297c44e7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:16.802616 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:16.803217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.803491 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.803756 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.804436 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:16.806327 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.834637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1410/2851] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:16 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:16.835949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:16.847754 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6b5b-50f1-4c42-9a39-702c5e688524 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:16.852518 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:16.853125 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.853401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.853828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.854475 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:16.856642 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.866937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1442/2852] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:16.871146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:16.884601 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75042-b2a8-4985-ba47-753aef89d56f admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:16.888968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450795ae-d261-4ecd-9ceb-cb75a15ffab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:16.889779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450795ae-d261-4ecd-9ceb-cb75a15ffab0 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.890325 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450795ae-d261-4ecd-9ceb-cb75a15ffab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.890669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450795ae-d261-4ecd-9ceb-cb75a15ffab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.891485 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450795ae-d261-4ecd-9ceb-cb75a15ffab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:16.893207 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450795ae-d261-4ecd-9ceb-cb75a15ffab0 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.907381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1411/2853] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:16.911523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:16.922358 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e514-698e-4938-9684-1790f43a386e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:16.927440 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:16.928124 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:16.928432 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:16.928712 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] PATH_INFO: `/v3/projects/44c49b8f467a4472834a5e601c8de641/users/1be2f56fbf584d95a6f59c37d2c88083/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:16.946017 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c49b8f467a4472834a5e601c8de641, user_id=1be2f56fbf584d95a6f59c37d2c88083, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:16.948735 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:16.962192 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1443/2854] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:16 2022] PUT /identity/v3/projects/44c49b8f467a4472834a5e601c8de641/users/1be2f56fbf584d95a6f59c37d2c88083/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:17.033384 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:17.033739 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:17.034005 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:17.064215 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] MFA Rules not processed for user `1be2f56fbf584d95a6f59c37d2c88083`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:17.065488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:17.127947 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:17.136848 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1412/2855] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:17.146142 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:17.148006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:17.211178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf146-5d14-4f6f-9756-19bb8606fd2b admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:17.215179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a07ad-d07f-4dd9-a19b-12b50045256a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:17.215789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a07ad-d07f-4dd9-a19b-12b50045256a service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:17.216084 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a07ad-d07f-4dd9-a19b-12b50045256a service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:17.216357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a07ad-d07f-4dd9-a19b-12b50045256a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:17.225003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a07ad-d07f-4dd9-a19b-12b50045256a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:17.226456 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a07ad-d07f-4dd9-a19b-12b50045256a service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:17.235647 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1444/2856] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:18.273845 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:18.275444 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:18.344760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99d39a-a8f8-495c-92df-a609730e2472 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:18.349826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:18.350483 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:18.350761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:18.351032 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] PATH_INFO: `/v3/users/a6c99e84c9d44007b9158b3afb365f85` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:18.352150 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c99e84c9d44007b9158b3afb365f85)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:18.354124 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:18.398709 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c99e84c9d44007b9158b3afb365f85'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:18.406117 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c99e84c9d44007b9158b3afb365f85'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:18.413205 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c99e84c9d44007b9158b3afb365f85'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:18.413761 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c99e84c9d44007b9158b3afb365f85'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:18.414359 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c99e84c9d44007b9158b3afb365f85'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:18.431747 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1413/2857] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:18 2022] DELETE /identity/v3/users/a6c99e84c9d44007b9158b3afb365f85 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:18.436191 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157750-e69f-41ac-a935-d47071443439 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:18.436725 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157750-e69f-41ac-a935-d47071443439 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:18.436828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157750-e69f-41ac-a935-d47071443439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:18.454855 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-79157750-e69f-41ac-a935-d47071443439 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:18.456030 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-79157750-e69f-41ac-a935-d47071443439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:18.512183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1445/2858] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:18.521646 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:18.523082 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:18.584221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633e665-7604-4e38-969e-7eb980fd9a9e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:18.587873 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:18.588584 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:18.588862 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:18.589130 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:18.599042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:18.600502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:18.610828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1414/2859] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:18.914916 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157750-e69f-41ac-a935-d47071443439 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:18.916716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-79157750-e69f-41ac-a935-d47071443439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:18.933528 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157750-e69f-41ac-a935-d47071443439 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:18.938611 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:18.939246 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:18.939525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:18.939799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] PATH_INFO: `/v3/projects/111a00f004654c69bf6d972270902335` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:18.941166 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] RBAC: Authorizing `identity:delete_project(project_id=111a00f004654c69bf6d972270902335)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:18.943220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:18.995472 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111a00f004654c69bf6d972270902335', 'request_id': 'req-53e91855-3ad3-42c8-8d2f-fa6ff045834a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:18.997666 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:19.002985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111a00f004654c69bf6d972270902335', 'request_id': 'req-53e91855-3ad3-42c8-8d2f-fa6ff045834a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.013263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111a00f004654c69bf6d972270902335', 'request_id': 'req-53e91855-3ad3-42c8-8d2f-fa6ff045834a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.024870 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] The token cache is being invalidate because project 111a00f004654c69bf6d972270902335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:19.025223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.025887 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.027365 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1446/2860] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:18 2022] DELETE /identity/v3/projects/111a00f004654c69bf6d972270902335 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:19.032084 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:19.042497 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01171fa-076c-410e-98d1-87e6bfeefe80 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:19.064801 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:19.114151 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:19.115055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:19.123500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:19.123500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] PATH_INFO: `/v3/users/8469478362d44e0e987ec8ab25501cef` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:19.123500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8469478362d44e0e987ec8ab25501cef)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:19.123500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:19.170249 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8469478362d44e0e987ec8ab25501cef'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.176981 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8469478362d44e0e987ec8ab25501cef'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.183606 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8469478362d44e0e987ec8ab25501cef'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.184856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8469478362d44e0e987ec8ab25501cef'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.185466 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8469478362d44e0e987ec8ab25501cef'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.203238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1415/2861] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:19 2022] DELETE /identity/v3/users/8469478362d44e0e987ec8ab25501cef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:19.494397 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:19.495881 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:19.511506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91855-3ad3-42c8-8d2f-fa6ff045834a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:19.575875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:19.576565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:19.576843 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:19.577115 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] PATH_INFO: `/v3/projects/87e1db50bcae43088f21fab4cf98c27d` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:19.578301 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e1db50bcae43088f21fab4cf98c27d)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:19.581092 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:19.630129 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e1db50bcae43088f21fab4cf98c27d', 'request_id': 'req-b31f8c08-3ba0-431d-b272-32a63c04894a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.636464 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e1db50bcae43088f21fab4cf98c27d', 'request_id': 'req-b31f8c08-3ba0-431d-b272-32a63c04894a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.644648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e1db50bcae43088f21fab4cf98c27d', 'request_id': 'req-b31f8c08-3ba0-431d-b272-32a63c04894a'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.656013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] The token cache is being invalidate because project 87e1db50bcae43088f21fab4cf98c27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:19.656435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.657060 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.661515 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1447/2862] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:19 2022] DELETE /identity/v3/projects/87e1db50bcae43088f21fab4cf98c27d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:19.662832 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:19.664369 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:19.677539 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31098a8b-73e2-40d8-86dd-e50eef42f618 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:19.739978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:19.740648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:19.740926 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:19.741200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] PATH_INFO: `/v3/users/462c1e6671824281a79e061a7c622ec3` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:19.742300 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462c1e6671824281a79e061a7c622ec3)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:19.744209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:19.784549 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:19.790088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462c1e6671824281a79e061a7c622ec3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.798603 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462c1e6671824281a79e061a7c622ec3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.806521 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462c1e6671824281a79e061a7c622ec3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.807346 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462c1e6671824281a79e061a7c622ec3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.808088 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-560bb1c9-d125-4d1f-b24b-237ee4ce3519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462c1e6671824281a79e061a7c622ec3'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:19.826232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1416/2863] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:19 2022] DELETE /identity/v3/users/462c1e6671824281a79e061a7c622ec3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:20.122463 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.124036 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:20.139418 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f8c08-3ba0-431d-b272-32a63c04894a admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.228031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.229110 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.229398 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.229674 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] PATH_INFO: `/v3/projects/7cb1736dc61d47b685bcb6192018b20e` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.230844 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb1736dc61d47b685bcb6192018b20e)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.232965 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.245183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:20.288653 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb1736dc61d47b685bcb6192018b20e', 'request_id': 'req-70713b3b-252e-4064-a03b-fb3ed65e2d47'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:20.295555 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb1736dc61d47b685bcb6192018b20e', 'request_id': 'req-70713b3b-252e-4064-a03b-fb3ed65e2d47'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:20.302741 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb1736dc61d47b685bcb6192018b20e', 'request_id': 'req-70713b3b-252e-4064-a03b-fb3ed65e2d47'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:20.314217 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] The token cache is being invalidate because project 7cb1736dc61d47b685bcb6192018b20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:20.314511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:20.315198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-70713b3b-252e-4064-a03b-fb3ed65e2d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:20.316745 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1448/2864] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:20 2022] DELETE /identity/v3/projects/7cb1736dc61d47b685bcb6192018b20e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:20.321462 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959259-098e-4c93-b4f2-306588555112 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.321835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959259-098e-4c93-b4f2-306588555112 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.322308 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30959259-098e-4c93-b4f2-306588555112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.343528 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-30959259-098e-4c93-b4f2-306588555112 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:20.344841 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-30959259-098e-4c93-b4f2-306588555112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:20.414040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1417/2865] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:20.422952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c15a-99f7-4af9-a799-3f1b3cc39f96 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.423363 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c15a-99f7-4af9-a799-3f1b3cc39f96 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.423812 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c15a-99f7-4af9-a799-3f1b3cc39f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.444452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-b0e2c15a-99f7-4af9-a799-3f1b3cc39f96 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:20.445655 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-b0e2c15a-99f7-4af9-a799-3f1b3cc39f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:20.455218 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1449/2866] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:20.459713 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30959259-098e-4c93-b4f2-306588555112 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.469424 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30959259-098e-4c93-b4f2-306588555112 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.474283 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.474870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.475145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.475412 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.476055 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:20.476352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.477968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.490763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1418/2867] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:20.495314 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c15a-99f7-4af9-a799-3f1b3cc39f96 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.506405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c15a-99f7-4af9-a799-3f1b3cc39f96 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.517065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.517684 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.517957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.518223 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.518862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.520958 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.549873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1450/2868] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:20 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:20.552643 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.562980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7fb2d-928d-43fd-a0d9-29f984c3f472 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.618237 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.618884 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.619163 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.619513 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.620154 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.622897 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.645941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1419/2869] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:20 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:20.650203 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.661402 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d868c-fbf1-4797-ba79-80f507674f3f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.666721 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.667338 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.667695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.668003 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.669228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.670900 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.681031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1451/2870] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:20.685320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.696918 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a658-3507-4ede-bad9-fbac50367dad admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.703503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990322e-a6cf-4872-980f-f0016e2c4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.704113 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990322e-a6cf-4872-980f-f0016e2c4610 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.704368 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990322e-a6cf-4872-980f-f0016e2c4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.704663 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990322e-a6cf-4872-980f-f0016e2c4610 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.705352 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990322e-a6cf-4872-980f-f0016e2c4610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.707060 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990322e-a6cf-4872-980f-f0016e2c4610 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.718522 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1420/2871] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:20.723382 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.736146 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c1308-c468-43b2-80d6-a94588d703cc admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.742102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.742896 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.743182 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.743547 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] PATH_INFO: `/v3/projects/35d7bbf5b68c48f6b66b2d4b1f539531/users/f442b560d68848b090f5d73a7009628b/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.763985 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d7bbf5b68c48f6b66b2d4b1f539531, user_id=f442b560d68848b090f5d73a7009628b, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.766538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.779323 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1452/2872] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:20 2022] PUT /identity/v3/projects/35d7bbf5b68c48f6b66b2d4b1f539531/users/f442b560d68848b090f5d73a7009628b/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:20.790986 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.791270 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.791565 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.818633 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] MFA Rules not processed for user `f442b560d68848b090f5d73a7009628b`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:20.819836 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:20.831870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:20.883585 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1421/2873] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:20.895351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:20.897058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:20.952992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e22aad-4557-4495-9382-ed3be772132f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:20.956569 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0bab-1a7d-40a1-b741-183d8868c6e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae893320e6c4ab996cdc2230172417e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:20.957154 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0bab-1a7d-40a1-b741-183d8868c6e7 service glance] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:20.957449 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0bab-1a7d-40a1-b741-183d8868c6e7 service glance] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:20.957695 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0bab-1a7d-40a1-b741-183d8868c6e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:20.966711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0bab-1a7d-40a1-b741-183d8868c6e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:20.968133 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0bab-1a7d-40a1-b741-183d8868c6e7 service glance] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:20.977651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1453/2874] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:22.683147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:22.685147 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:22.749200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255051c7-03f3-4843-94c8-8ffcb131c008 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:22.753789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:22.754406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:22.754682 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:22.754954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] PATH_INFO: `/v3/users/1be2f56fbf584d95a6f59c37d2c88083` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:22.756069 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be2f56fbf584d95a6f59c37d2c88083)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:22.758033 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:22.803009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be2f56fbf584d95a6f59c37d2c88083'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:22.810381 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be2f56fbf584d95a6f59c37d2c88083'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:22.818146 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be2f56fbf584d95a6f59c37d2c88083'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:22.818780 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be2f56fbf584d95a6f59c37d2c88083'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:22.819422 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be2f56fbf584d95a6f59c37d2c88083'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:22.845233 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1422/2875] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:22 2022] DELETE /identity/v3/users/1be2f56fbf584d95a6f59c37d2c88083 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:22.849946 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:22.850420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:22.850544 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:22.869244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:22.870447 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:22.903746 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:22.945266 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1454/2876] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:22.955678 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:22.957079 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:22.991929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:23.020913 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd9b4-34a8-43ef-a491-23a6e6b6d6de admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.024612 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d9773-50bf-4a43-8e18-2bcff2b0f9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.025251 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d9773-50bf-4a43-8e18-2bcff2b0f9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.025530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d9773-50bf-4a43-8e18-2bcff2b0f9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.025803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d9773-50bf-4a43-8e18-2bcff2b0f9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.035380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d9773-50bf-4a43-8e18-2bcff2b0f9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.037157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d9773-50bf-4a43-8e18-2bcff2b0f9b9 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.047111 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1423/2877] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 00:37:23.316556 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.319676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:23.333971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5911b6c-a162-4f14-9b65-1e7ad94b2bde None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.345731 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.346541 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.346895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.349628 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] PATH_INFO: `/v3/projects/44c49b8f467a4472834a5e601c8de641` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.351937 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c49b8f467a4472834a5e601c8de641)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.354697 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.409180 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c49b8f467a4472834a5e601c8de641', 'request_id': 'req-d71e98b7-ac1b-49cc-96f2-f940873acb7e'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:23.415189 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c49b8f467a4472834a5e601c8de641', 'request_id': 'req-d71e98b7-ac1b-49cc-96f2-f940873acb7e'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:23.423040 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c49b8f467a4472834a5e601c8de641', 'request_id': 'req-d71e98b7-ac1b-49cc-96f2-f940873acb7e'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:23.433267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] The token cache is being invalidate because project 44c49b8f467a4472834a5e601c8de641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:23.433564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:23.434784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-d71e98b7-ac1b-49cc-96f2-f940873acb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:23.436784 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1455/2878] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:23 2022] DELETE /identity/v3/projects/44c49b8f467a4472834a5e601c8de641 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:23.441716 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdfa52-9422-46d6-901b-f2d298e2e377 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.442004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdfa52-9422-46d6-901b-f2d298e2e377 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.442280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdfa52-9422-46d6-901b-f2d298e2e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.461294 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-56cdfa52-9422-46d6-901b-f2d298e2e377 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:23.462478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-56cdfa52-9422-46d6-901b-f2d298e2e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:23.535961 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1424/2879] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:23.543944 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356008a-e5b6-47dd-a1e1-b45de3dacd86 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.544265 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356008a-e5b6-47dd-a1e1-b45de3dacd86 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.544572 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356008a-e5b6-47dd-a1e1-b45de3dacd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.563894 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-8356008a-e5b6-47dd-a1e1-b45de3dacd86 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:23.565109 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-8356008a-e5b6-47dd-a1e1-b45de3dacd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:23.572819 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1456/2880] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 00:37:23.577428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdfa52-9422-46d6-901b-f2d298e2e377 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.587108 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdfa52-9422-46d6-901b-f2d298e2e377 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.592355 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.592966 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.593238 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.593500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.594179 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:23.594478 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.596109 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.608133 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1425/2881] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:23.612801 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356008a-e5b6-47dd-a1e1-b45de3dacd86 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.621969 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356008a-e5b6-47dd-a1e1-b45de3dacd86 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.626600 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.627177 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.627452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.627717 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.628342 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.630254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.657454 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1457/2882] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:23 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:23.661488 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.671597 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3597-9c8a-4480-becc-ee34dad22054 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.731379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.732081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.732469 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.732746 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.733671 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.735972 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.760969 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1426/2883] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:23 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:23.765272 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.775675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457381ae-d7b6-4895-9285-c6e6761dd97d admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.781006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.781602 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.781884 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.782186 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.782875 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.784537 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.795069 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1458/2884] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:23.798778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.809382 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe8f23-4c1e-4cdd-8495-a51c59e8ea83 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.814004 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50eb86-fa45-462a-afac-26a931cc03ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.814581 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50eb86-fa45-462a-afac-26a931cc03ce admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.814856 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50eb86-fa45-462a-afac-26a931cc03ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.815120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50eb86-fa45-462a-afac-26a931cc03ce admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.815744 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50eb86-fa45-462a-afac-26a931cc03ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.817360 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50eb86-fa45-462a-afac-26a931cc03ce admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.829187 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1427/2885] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:23.833286 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.843199 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df60d-a91c-4b8a-a6ce-8c7db1888a50 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:23.847979 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:23.848652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.848935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.849211 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] PATH_INFO: `/v3/projects/b8ab0ffac0b7481891b94f1b7974887d/users/1c241099f9274cbab9b4f22ba83f100c/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.863244 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ab0ffac0b7481891b94f1b7974887d, user_id=1c241099f9274cbab9b4f22ba83f100c, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:23.865906 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:23.878676 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1459/2886] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:23 2022] PUT /identity/v3/projects/b8ab0ffac0b7481891b94f1b7974887d/users/1c241099f9274cbab9b4f22ba83f100c/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:23.890591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ddbc-628b-4cd0-9de1-b11023f07220 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:23.890871 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ddbc-628b-4cd0-9de1-b11023f07220 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:23.891143 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ddbc-628b-4cd0-9de1-b11023f07220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:23.920544 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-a832ddbc-628b-4cd0-9de1-b11023f07220 None None] MFA Rules not processed for user `1c241099f9274cbab9b4f22ba83f100c`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:23.921798 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a832ddbc-628b-4cd0-9de1-b11023f07220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:23.951828 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:23.985135 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1428/2887] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:23.995657 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:23.997852 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:24.053169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507a3a0-4dec-4a12-94bc-efc2d1c52425 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:24.056992 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe314e-dba7-4361-8c9f-69c07ff2bb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:24.057772 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe314e-dba7-4361-8c9f-69c07ff2bb2a service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:24.058088 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe314e-dba7-4361-8c9f-69c07ff2bb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:24.058361 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe314e-dba7-4361-8c9f-69c07ff2bb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:24.068550 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe314e-dba7-4361-8c9f-69c07ff2bb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:24.070004 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe314e-dba7-4361-8c9f-69c07ff2bb2a service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:24.078877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1460/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:27.107177 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ddbc-628b-4cd0-9de1-b11023f07220 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:27.167232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ddbc-628b-4cd0-9de1-b11023f07220 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:27.172204 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:27.172847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:27.173126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:27.173401 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] PATH_INFO: `/v3/users/1c241099f9274cbab9b4f22ba83f100c` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:27.174514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c241099f9274cbab9b4f22ba83f100c)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:27.176471 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:27.221358 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c241099f9274cbab9b4f22ba83f100c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.228250 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c241099f9274cbab9b4f22ba83f100c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.236534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c241099f9274cbab9b4f22ba83f100c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.237194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c241099f9274cbab9b4f22ba83f100c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.237980 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c241099f9274cbab9b4f22ba83f100c'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.268319 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1429/2889] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:27 2022] DELETE /identity/v3/users/1c241099f9274cbab9b4f22ba83f100c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:27.273503 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:27.274013 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:27.274134 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:27.282098 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:27.302648 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:27.304159 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:27.363344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1461/2890] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:27.373631 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:27.375014 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:27.433870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31ba5-d103-45e7-a1e0-a70113640bf4 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:27.437526 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00c1ba-a28f-4e23-aec2-7b712a5bd7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:27.438126 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c1ba-a28f-4e23-aec2-7b712a5bd7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:27.438397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c1ba-a28f-4e23-aec2-7b712a5bd7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:27.438662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c1ba-a28f-4e23-aec2-7b712a5bd7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:27.444582 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:27.449187 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00c1ba-a28f-4e23-aec2-7b712a5bd7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:27.451406 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00c1ba-a28f-4e23-aec2-7b712a5bd7b3 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:27.461061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1430/2891] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:27.747795 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:27.749344 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:27.761457 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a8257-04a9-4e02-a8f3-88c103eda130 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:27.766520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:27.767145 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:27.767421 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:27.767690 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] PATH_INFO: `/v3/projects/b8ab0ffac0b7481891b94f1b7974887d` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:27.768829 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ab0ffac0b7481891b94f1b7974887d)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:27.770723 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:27.819941 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ab0ffac0b7481891b94f1b7974887d', 'request_id': 'req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.826619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ab0ffac0b7481891b94f1b7974887d', 'request_id': 'req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.834740 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ab0ffac0b7481891b94f1b7974887d', 'request_id': 'req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.846825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] The token cache is being invalidate because project b8ab0ffac0b7481891b94f1b7974887d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:27.847118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.848056 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-79e7ce2e-d2f6-4e8d-bfad-b80106ac4380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:27.849617 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1462/2892] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:27 2022] DELETE /identity/v3/projects/b8ab0ffac0b7481891b94f1b7974887d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:27.854645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b467f-aeb8-44b3-a89d-184a557ff179 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:27.854974 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b467f-aeb8-44b3-a89d-184a557ff179 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:27.855245 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b467f-aeb8-44b3-a89d-184a557ff179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:27.874525 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-7b1b467f-aeb8-44b3-a89d-184a557ff179 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:27.875689 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-7b1b467f-aeb8-44b3-a89d-184a557ff179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:27.933933 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1431/2893] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:27.941898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bebc-d90f-4fcb-9bca-23053afe10cd None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:27.942179 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bebc-d90f-4fcb-9bca-23053afe10cd None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:27.942448 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bebc-d90f-4fcb-9bca-23053afe10cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:27.963147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-cc79bebc-d90f-4fcb-9bca-23053afe10cd None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:27.964324 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-cc79bebc-d90f-4fcb-9bca-23053afe10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:27.972953 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1463/2894] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:27.977000 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b467f-aeb8-44b3-a89d-184a557ff179 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:27.986523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b467f-aeb8-44b3-a89d-184a557ff179 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:27.991176 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:27.991762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:27.992044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:27.992301 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:27.992982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:27.993280 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:27.994860 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:28.007433 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1432/2895] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:28.012516 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bebc-d90f-4fcb-9bca-23053afe10cd None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:28.022499 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bebc-d90f-4fcb-9bca-23053afe10cd None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:28.027096 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:28.027683 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:28.027956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:28.028222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:28.029435 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:28.031312 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:28.056111 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1464/2896] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:28 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:28.060442 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:28.070339 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222ecb2-979e-42fc-bd50-3c932ab9e872 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:28.132059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:28.132750 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:28.132872 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:28.133120 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:28.133736 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:28.135634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:28.155615 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1433/2897] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:28 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:28.159967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:28.170891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b23259-68c3-4b7c-aa0b-0ee334663f43 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:28.176643 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:28.180410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:28.180410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:28.180410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:28.180410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:28.180410 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:28.192730 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1465/2898] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:28.196839 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:28.207467 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80953f-f599-4dee-9f76-0741fcbb4e9e admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:28.212100 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc35ca5-0830-4500-9985-de11961e9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:28.212720 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc35ca5-0830-4500-9985-de11961e9739 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:28.212998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc35ca5-0830-4500-9985-de11961e9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:28.213267 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc35ca5-0830-4500-9985-de11961e9739 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:28.213900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc35ca5-0830-4500-9985-de11961e9739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:28.215530 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc35ca5-0830-4500-9985-de11961e9739 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:28.227857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1434/2899] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:28.231891 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:28.242041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ed3f1-f004-4667-8cc9-0d7e4c772091 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:28.246618 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:28.248250 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:28.248564 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:28.248835 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] PATH_INFO: `/v3/projects/0a8def5aa00945e59c590c90dc03a0b7/users/2363cd4bfc0f4009a7a94a16a946574a/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:28.263832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8def5aa00945e59c590c90dc03a0b7, user_id=2363cd4bfc0f4009a7a94a16a946574a, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:28.266595 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:28.279224 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1466/2900] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:28 2022] PUT /identity/v3/projects/0a8def5aa00945e59c590c90dc03a0b7/users/2363cd4bfc0f4009a7a94a16a946574a/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:28.289613 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421548d-2851-4e3b-8968-d002d68aa21d None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:28.289896 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421548d-2851-4e3b-8968-d002d68aa21d None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:28.290167 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421548d-2851-4e3b-8968-d002d68aa21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:28.317634 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-6421548d-2851-4e3b-8968-d002d68aa21d None None] MFA Rules not processed for user `2363cd4bfc0f4009a7a94a16a946574a`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:28.318822 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6421548d-2851-4e3b-8968-d002d68aa21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:28.366174 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:28.386489 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1435/2901] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:28.398024 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:28.399760 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:28.425756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:28.458263 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbe382-925f-491e-b66b-b44302602f1e admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:28.461913 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a2375-b0e4-4cc0-a301-f0eb9012d13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5a31dd48b6b4377a0eb375502344dcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:28.462504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a2375-b0e4-4cc0-a301-f0eb9012d13c service cinder] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:28.462777 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a2375-b0e4-4cc0-a301-f0eb9012d13c service cinder] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:28.463044 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a2375-b0e4-4cc0-a301-f0eb9012d13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:28.471085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a2375-b0e4-4cc0-a301-f0eb9012d13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:28.472791 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a2375-b0e4-4cc0-a301-f0eb9012d13c service cinder] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:28.482005 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1467/2902] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:38.383328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:38.477484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=16 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:38.545194 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421548d-2851-4e3b-8968-d002d68aa21d None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:38.629379 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421548d-2851-4e3b-8968-d002d68aa21d None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:38.634490 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:38.635274 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:38.635441 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:38.635776 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] PATH_INFO: `/v3/users/2363cd4bfc0f4009a7a94a16a946574a` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:38.636964 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2363cd4bfc0f4009a7a94a16a946574a)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:38.639693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:38.686892 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2363cd4bfc0f4009a7a94a16a946574a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:38.693725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2363cd4bfc0f4009a7a94a16a946574a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:38.699844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2363cd4bfc0f4009a7a94a16a946574a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:38.700503 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2363cd4bfc0f4009a7a94a16a946574a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:38.701112 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2363cd4bfc0f4009a7a94a16a946574a'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:38.718326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1436/2903] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:38 2022] DELETE /identity/v3/users/2363cd4bfc0f4009a7a94a16a946574a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:38.723267 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:38.723553 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:38.723828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:38.742548 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:38.743743 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:38.800522 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1468/2904] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:38.810159 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:38.812086 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:38.868803 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193e29-cdd9-4bfe-a9ff-24f5a4e1986b admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:38.872536 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:38.873625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:38.873911 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:38.874169 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:38.883011 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:38.884450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:38.894347 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1437/2905] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:39.152828 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:39.154227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:39.167118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba8836-2cd0-45c9-aa2e-72310d624b14 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:39.172197 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:39.172974 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:39.173254 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:39.173521 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] PATH_INFO: `/v3/projects/0a8def5aa00945e59c590c90dc03a0b7` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:39.174630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8def5aa00945e59c590c90dc03a0b7)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:39.176554 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:39.222711 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8def5aa00945e59c590c90dc03a0b7', 'request_id': 'req-ecd790d6-ec31-4640-b0e8-9972a9359c44'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:39.228656 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8def5aa00945e59c590c90dc03a0b7', 'request_id': 'req-ecd790d6-ec31-4640-b0e8-9972a9359c44'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:39.236665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8def5aa00945e59c590c90dc03a0b7', 'request_id': 'req-ecd790d6-ec31-4640-b0e8-9972a9359c44'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:39.246792 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] The token cache is being invalidate because project 0a8def5aa00945e59c590c90dc03a0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:39.247085 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:39.247702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-ecd790d6-ec31-4640-b0e8-9972a9359c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:39.249862 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1469/2906] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:39 2022] DELETE /identity/v3/projects/0a8def5aa00945e59c590c90dc03a0b7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:43.126929 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:43.128509 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:43.142166 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67842a81-3d27-450e-bad8-9bd7ed68ee0c service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:43.164247 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:43.207766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:43.208420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:43.208819 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:43.209105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] PATH_INFO: `/v3/users/09435e9ed47a4e5f9a813bc1359b020b` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:43.210118 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09435e9ed47a4e5f9a813bc1359b020b)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:43.212027 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:43.260811 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09435e9ed47a4e5f9a813bc1359b020b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.268554 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09435e9ed47a4e5f9a813bc1359b020b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.277751 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09435e9ed47a4e5f9a813bc1359b020b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.278373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09435e9ed47a4e5f9a813bc1359b020b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.278975 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09435e9ed47a4e5f9a813bc1359b020b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.298041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1438/2907] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:43 2022] DELETE /identity/v3/users/09435e9ed47a4e5f9a813bc1359b020b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:43.302594 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:43.303121 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:43.303355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:43.322478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:43.323686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:43.385956 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1470/2908] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:43.396208 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:43.397855 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:43.477310 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36323ff9-0529-450f-8845-34642b793208 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:43.481073 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:43.481669 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:43.481942 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:43.482271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:43.491882 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:43.493354 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:43.502840 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1439/2909] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:43.770877 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:43.772376 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:43.785152 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aa982-2678-4219-bfa0-81ae085e80c7 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:43.789751 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:43.790375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:43.790649 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:43.790920 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] PATH_INFO: `/v3/projects/63d99a6bf0f044f09bfc57277b49f3f4` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:43.792120 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d99a6bf0f044f09bfc57277b49f3f4)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:43.794058 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:43.816289 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:43.843102 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d99a6bf0f044f09bfc57277b49f3f4', 'request_id': 'req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.849403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d99a6bf0f044f09bfc57277b49f3f4', 'request_id': 'req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.856568 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d99a6bf0f044f09bfc57277b49f3f4', 'request_id': 'req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.866672 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] The token cache is being invalidate because project 63d99a6bf0f044f09bfc57277b49f3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:43.866957 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.867579 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-0d49a7cc-a817-4a6c-bd92-3bb64d5fb08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:43.869086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1471/2910] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:43 2022] DELETE /identity/v3/projects/63d99a6bf0f044f09bfc57277b49f3f4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:49.084542 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:49.086431 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:49.099701 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d184-a93f-4b57-bb47-4c3bcf0ecdc6 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:49.139767 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:49.156514 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:49.157131 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.157402 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.157666 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] PATH_INFO: `/v3/users/f442b560d68848b090f5d73a7009628b` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.158778 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f442b560d68848b090f5d73a7009628b)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:49.160723 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:49.206400 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f442b560d68848b090f5d73a7009628b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.213617 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f442b560d68848b090f5d73a7009628b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.221411 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f442b560d68848b090f5d73a7009628b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.222440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f442b560d68848b090f5d73a7009628b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.223081 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f442b560d68848b090f5d73a7009628b'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.241235 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1440/2911] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:37:49 2022] DELETE /identity/v3/users/f442b560d68848b090f5d73a7009628b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:49.245691 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.246171 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.246298 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.264989 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:49.266181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:49.323355 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1472/2912] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:49.332982 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:49.334387 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:49.396373 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa318b9-313d-41f3-9f65-2bec6644c71a admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:49.400041 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c88a04-1f88-43df-9152-28d0fc9904ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:49.400656 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c88a04-1f88-43df-9152-28d0fc9904ba service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.400938 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c88a04-1f88-43df-9152-28d0fc9904ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.401209 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c88a04-1f88-43df-9152-28d0fc9904ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.410760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c88a04-1f88-43df-9152-28d0fc9904ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:49.412221 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c88a04-1f88-43df-9152-28d0fc9904ba service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:49.421693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1441/2913] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:49.689354 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:49.690952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:49.705086 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37db6-1cbe-4a27-b968-29dadb2abf40 None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:49.710143 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:49.710949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.711231 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.711570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] PATH_INFO: `/v3/projects/35d7bbf5b68c48f6b66b2d4b1f539531` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.712716 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d7bbf5b68c48f6b66b2d4b1f539531)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:49.714630 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:49.763059 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d7bbf5b68c48f6b66b2d4b1f539531', 'request_id': 'req-741c2139-d9ef-4ebf-b48a-981d3e533982'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.769184 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d7bbf5b68c48f6b66b2d4b1f539531', 'request_id': 'req-741c2139-d9ef-4ebf-b48a-981d3e533982'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.776020 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d7bbf5b68c48f6b66b2d4b1f539531', 'request_id': 'req-741c2139-d9ef-4ebf-b48a-981d3e533982'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.786451 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] The token cache is being invalidate because project 35d7bbf5b68c48f6b66b2d4b1f539531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:37:49.786733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.787343 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-741c2139-d9ef-4ebf-b48a-981d3e533982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:37:49.788854 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1473/2914] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:37:49 2022] DELETE /identity/v3/projects/35d7bbf5b68c48f6b66b2d4b1f539531 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:49.793760 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d87cb2-7e99-42de-a55c-29ca6ef5ba01 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.794044 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d87cb2-7e99-42de-a55c-29ca6ef5ba01 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.794318 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d87cb2-7e99-42de-a55c-29ca6ef5ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.814573 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-87d87cb2-7e99-42de-a55c-29ca6ef5ba01 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:49.815881 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-87d87cb2-7e99-42de-a55c-29ca6ef5ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:49.874464 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1442/2915] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:49.882406 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb80d3-8255-4c53-a69f-e4fd3d1a257d None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.882733 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb80d3-8255-4c53-a69f-e4fd3d1a257d None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.883006 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb80d3-8255-4c53-a69f-e4fd3d1a257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.902227 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-dcbb80d3-8255-4c53-a69f-e4fd3d1a257d None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:49.903401 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-dcbb80d3-8255-4c53-a69f-e4fd3d1a257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:49.911658 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1474/2916] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:49.915879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d87cb2-7e99-42de-a55c-29ca6ef5ba01 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:49.925949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d87cb2-7e99-42de-a55c-29ca6ef5ba01 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:49.930440 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:49.931019 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.931292 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.931557 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] PATH_INFO: `/v3/domains` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.932189 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 00:37:49.932512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:49.934092 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:49.935496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:49.947988 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1443/2917] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Sep 1 00:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 00:37:49.952277 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb80d3-8255-4c53-a69f-e4fd3d1a257d None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:49.961562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb80d3-8255-4c53-a69f-e4fd3d1a257d None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:49.966187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:49.966769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:49.967065 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:49.967316 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:49.967943 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:49.970348 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:49.997523 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1475/2918] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:50.001388 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:50.011534 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dcb07-1a6e-4b22-b0a4-22ffd357f397 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:50.067454 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:50.068046 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:50.068326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:50.068627 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:50.069254 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:50.071298 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:50.091843 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1444/2919] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:50 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 00:37:50.096419 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:50.102107 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:50.112765 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ba87-351f-448a-b143-ed8f738ecaaf admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:50.118423 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:50.119031 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:50.119309 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:50.119593 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:50.120228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:50.121895 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:50.132181 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1476/2920] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:50.136223 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:50.149979 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a87c-7672-4bce-a672-fd8ebb2f36ab admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:50.158833 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fa65-cefb-42f3-a4c9-845b1a075ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:50.159427 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fa65-cefb-42f3-a4c9-845b1a075ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:50.159698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fa65-cefb-42f3-a4c9-845b1a075ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:50.159962 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fa65-cefb-42f3-a4c9-845b1a075ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:50.160637 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2fa65-cefb-42f3-a4c9-845b1a075ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:50.162232 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2fa65-cefb-42f3-a4c9-845b1a075ac4 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:50.174181 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1445/2921] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:50.178481 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:50.188808 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008830fe-1793-4116-a1e4-d27b98306437 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:50.193478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:50.194118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] REQUEST_METHOD: `PUT` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:50.194393 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:50.194668 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] PATH_INFO: `/v3/projects/6b42770f944a407ab59ae33438fa3ffa/users/f59a086693ea4607a1767117c91b3e75/roles/42931b58092d490eb3e62614a2778775` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:50.209511 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b42770f944a407ab59ae33438fa3ffa, user_id=f59a086693ea4607a1767117c91b3e75, role_id=42931b58092d490eb3e62614a2778775)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:50.212141 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:50.226201 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1477/2922] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:50 2022] PUT /identity/v3/projects/6b42770f944a407ab59ae33438fa3ffa/users/f59a086693ea4607a1767117c91b3e75/roles/42931b58092d490eb3e62614a2778775 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:50.231297 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5a1e-488c-461e-9131-2d933a07adf3 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:50.231576 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5a1e-488c-461e-9131-2d933a07adf3 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:50.231847 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5a1e-488c-461e-9131-2d933a07adf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:50.251145 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-ba2d5a1e-488c-461e-9131-2d933a07adf3 None None] MFA Rules not processed for user `8f836d711bd446dd99381e699620c0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:50.252328 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ba2d5a1e-488c-461e-9131-2d933a07adf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:50.310271 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1446/2923] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:50.320176 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:50.321890 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:50.379813 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc5e17-120b-4818-af40-288ba3a834fc admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:50.383484 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:50.384018 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:50.384295 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:50.384591 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:50.393399 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:50.394873 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:50.404147 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1478/2924] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:37:54.297844 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da728d4-6813-4c96-8ad0-c73dcd86b084 None None] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:54.298323 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da728d4-6813-4c96-8ad0-c73dcd86b084 None None] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:54.298445 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da728d4-6813-4c96-8ad0-c73dcd86b084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:54.351520 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.auth.core [None req-0da728d4-6813-4c96-8ad0-c73dcd86b084 None None] MFA Rules not processed for user `f59a086693ea4607a1767117c91b3e75`. Rule list: `[]` (Enabled: `True`). {{(pid=93163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:54.352846 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-0da728d4-6813-4c96-8ad0-c73dcd86b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:54.409954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:54.447200 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1447/2925] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:54.452236 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:54.517705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30aefa-cbdf-40ef-8239-462d2843bbd5 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:54.523562 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:54.524357 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:54.525840 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:54.528333 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] PATH_INFO: `/v3/projects` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:54.528584 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:54.531103 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:54.576949 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1479/2926] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Sep 1 00:37:54 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:54.580870 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da728d4-6813-4c96-8ad0-c73dcd86b084 None None] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:54.599132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da728d4-6813-4c96-8ad0-c73dcd86b084 None None] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:54.669866 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:54.670479 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] REQUEST_METHOD: `POST` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:54.670762 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:54.671063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] PATH_INFO: `/v3/users` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:54.671698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:54.673662 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:54.696321 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1448/2927] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Sep 1 00:37:54 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 00:37:54.700187 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:54.711479 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878862-2369-4f41-a7fd-0546d63d850f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:54.716830 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:54.718825 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:54.719762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:54.720430 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:54.721405 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:54.724580 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:54.736971 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1480/2928] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:54.741289 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:54.751879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6630bce-7b37-48b1-b97b-f599af2ac229 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:54.757796 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:54.758826 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:54.759105 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:54.759378 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] PATH_INFO: `/v3/projects/652d58adb3a84b8ba5c2345123c56209/users/f00cb556303d40f1adf2aa482a931db8/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:54.778242 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652d58adb3a84b8ba5c2345123c56209, user_id=f00cb556303d40f1adf2aa482a931db8, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:54.782196 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:54.797831 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1449/2929] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:54 2022] PUT /identity/v3/projects/652d58adb3a84b8ba5c2345123c56209/users/f00cb556303d40f1adf2aa482a931db8/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 00:37:54.801817 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:54.812878 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbb3a0-5ba3-412f-8d8a-20cdb9a8522f admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:54.861228 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:54.874935 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c8190-65e1-41a4-987c-9493954dca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:54.875482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8190-65e1-41a4-987c-9493954dca72 admin admin] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:54.875763 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8190-65e1-41a4-987c-9493954dca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:54.876041 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8190-65e1-41a4-987c-9493954dca72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:54.876713 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c8190-65e1-41a4-987c-9493954dca72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:54.878313 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c8190-65e1-41a4-987c-9493954dca72 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:54.888538 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1481/2930] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Sep 1 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 00:37:54.893365 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:54.903428 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb390b3-022f-4af8-b7f7-2a144235f793 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:54.909059 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:54.909702 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:54.909978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:54.910246 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] PATH_INFO: `/v3/projects/652d58adb3a84b8ba5c2345123c56209/users/f00cb556303d40f1adf2aa482a931db8/roles/a0559ae5fc294f8a936407225ebf74d2` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:54.912157 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652d58adb3a84b8ba5c2345123c56209, user_id=f00cb556303d40f1adf2aa482a931db8, role_id=a0559ae5fc294f8a936407225ebf74d2)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:54.914894 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:54.925058 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1450/2931] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Sep 1 00:37:54 2022] PUT /identity/v3/projects/652d58adb3a84b8ba5c2345123c56209/users/f00cb556303d40f1adf2aa482a931db8/roles/a0559ae5fc294f8a936407225ebf74d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:37:59.312619 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9d4c-e499-4716-a737-a2b3121b1c0a None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:59.313140 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9d4c-e499-4716-a737-a2b3121b1c0a None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:59.313253 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9d4c-e499-4716-a737-a2b3121b1c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:59.349257 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-a76a9d4c-e499-4716-a737-a2b3121b1c0a None None] MFA Rules not processed for user `f00cb556303d40f1adf2aa482a931db8`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:37:59.350531 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a76a9d4c-e499-4716-a737-a2b3121b1c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:59.438242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1482/2932] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:37:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:37:59.459943 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:37:59.461719 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:37:59.560161 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:59.594717 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6578c7-3793-4be2-a097-85f10f9f9bf7 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:37:59.600625 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:37:59.601290 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:37:59.601512 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:37:59.601782 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:37:59.659394 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:37:59.660946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:37:59.670202 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1451/2933] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:37:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:38:00.650952 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] REQUEST_METHOD: `POST` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:38:00.651495 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:38:00.651679 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:38:00.675525 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.auth.core [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] MFA Rules not processed for user `f59a086693ea4607a1767117c91b3e75`. Rule list: `[]` (Enabled: `True`). {{(pid=93164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 00:38:00.677446 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:38:00.685106 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1483/2934] 10.222.0.13 () {58 vars in 958 bytes} [Thu Sep 1 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 00:38:02.349978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:38:02.351498 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:38:02.465273 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab5f27-7ef5-4abd-889f-aad0e60a5a5a service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:38:02.471504 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:38:02.472496 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:38:02.472850 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:38:02.473183 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:38:02.475523 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:38:02.493001 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:38:02.494978 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:38:02.506063 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1452/2935] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:38:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:38:10.669089 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=45 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:12.501132 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=76 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:13.033827 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:38:13.035258 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:38:13.112178 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6a91-4101-437b-9c75-ff43aa22273e None None] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:38:13.115790 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:38:13.116403 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:38:13.116692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:38:13.116967 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:38:13.118675 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:38:13.128565 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:38:13.129993 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:38:13.140756 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1484/2936] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:38:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:38:23.134652 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=35 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:28.973023 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:38:28.982924 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ecd2-97e5-4102-8088-d47db6fc48ce service placement] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:38:28.986835 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:38:28.987425 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:38:28.987698 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:38:28.987963 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:38:28.996763 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:38:28.998172 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:38:29.007326 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1453/2937] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:38:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:38:39.003220 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=6 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:24.812991 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:40:24.821705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6a38-eed4-4ade-ac44-4fd1a330e102 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:40:24.825506 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:40:24.826130 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:40:24.826408 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:40:24.826692 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:40:24.828437 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:24.842183 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:40:24.843601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:40:24.855504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1485/2938] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:40:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:40:26.031042 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:40:26.040533 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12804708-accf-45a5-93a1-c6928d737c83 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:40:26.044110 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:40:26.044732 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:40:26.045009 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:40:26.045279 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:40:26.046998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:26.060006 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:40:26.061450 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:40:26.072236 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1454/2939] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:40:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:40:34.850752 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=6 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:34.962520 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:40:34.971487 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206d98a-17cf-4358-8bef-229489fcbe9f service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:40:34.975118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:40:34.975705 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:40:34.975981 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:40:34.976251 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:40:34.978012 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:34.987438 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:40:34.989381 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:40:34.997389 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1486/2940] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:40:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:40:36.067420 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=6 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:38.079134 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:40:38.088789 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737c11c-b9ce-4b34-856f-4c89dd038749 service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:40:38.098691 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:40:38.099240 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:40:38.099519 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:40:38.099790 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:40:38.101725 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:38.112103 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:40:38.113693 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:40:38.121868 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1455/2941] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:40:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:40:38.197836 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:40:38.206621 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b67f-4948-4845-92a4-4d23c81a7aa0 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:40:38.210689 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa7f3487b674e75afe5fca74db44807', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:40:38.211279 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:40:38.211551 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:40:38.211815 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:40:38.213651 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:38.228375 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:40:38.229832 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:40:38.241118 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1487/2942] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:40:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:40:38.413197 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:40:38.414591 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:38.429217 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43f7fc-1bf9-4715-9b14-70b738d19a8a service neutron] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:40:38.434191 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:40:38.434779 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:40:38.435061 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:40:38.435336 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:40:38.437040 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:38.448721 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:40:38.450322 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:40:38.460879 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1456/2943] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:40:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:40:40.720728 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:40:40.722948 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:40.738924 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b074-6f25-406a-9d73-896f92482065 service neutron] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:40:40.744615 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:40:40.745222 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:40:40.745504 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:40:40.745789 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:40:40.747601 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:40:40.760799 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:40:40.762452 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:40:40.773718 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1488/2944] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:40:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:40:48.455941 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=12 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:50.768482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=18 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:41:55.901757 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:41:55.917439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ae15a-4b0c-41d6-82fa-43a9813578f5 service placement] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:41:55.923645 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63bab6bcfed4cb3b05de6ad4a4b43a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:41:55.924253 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:41:55.924578 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:41:55.924902 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:41:55.926566 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:41:55.939500 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:41:55.941158 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:41:55.952639 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1457/2945] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:41:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:42:02.788626 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:42:02.804242 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e988-74c7-4683-9d6d-97918518dbc0 service nova] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:42:02.809769 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:42:02.810570 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] REQUEST_METHOD: `GET` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:42:02.811022 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:42:02.811478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:42:02.817904 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:42:02.832736 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:42:02.834341 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:42:02.845961 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1489/2946] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:42:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:42:05.703674 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:42:05.779766 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c870a-9724-4ecc-ae02-c280410f9924 service nova] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:42:05.784568 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:42:05.785195 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:42:05.785507 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:42:05.785775 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] PATH_INFO: `/v3/users/f59a086693ea4607a1767117c91b3e75` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:42:05.786903 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59a086693ea4607a1767117c91b3e75)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:42:05.788946 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:42:05.833484 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59a086693ea4607a1767117c91b3e75'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:05.840857 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59a086693ea4607a1767117c91b3e75'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:05.848291 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59a086693ea4607a1767117c91b3e75'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:05.848949 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59a086693ea4607a1767117c91b3e75'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:05.849580 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59a086693ea4607a1767117c91b3e75'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:05.866451 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1458/2947] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:42:05 2022] DELETE /identity/v3/users/f59a086693ea4607a1767117c91b3e75 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:42:06.034351 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:42:06.045482 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216ec5b-4f29-49aa-80b1-a87c445b0011 service placement] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:42:06.102386 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:42:06.103011 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:42:06.103898 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:42:06.104169 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] PATH_INFO: `/v3/projects/6b42770f944a407ab59ae33438fa3ffa` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:42:06.105292 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b42770f944a407ab59ae33438fa3ffa)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:42:06.107173 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:42:06.152640 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b42770f944a407ab59ae33438fa3ffa', 'request_id': 'req-bc47d71e-3225-49de-b398-8c7ea3078e51'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.158702 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b42770f944a407ab59ae33438fa3ffa', 'request_id': 'req-bc47d71e-3225-49de-b398-8c7ea3078e51'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.166823 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b42770f944a407ab59ae33438fa3ffa', 'request_id': 'req-bc47d71e-3225-49de-b398-8c7ea3078e51'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.177478 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] The token cache is being invalidate because project 6b42770f944a407ab59ae33438fa3ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:42:06.177762 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.178396 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.179885 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1490/2948] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:42:06 2022] DELETE /identity/v3/projects/6b42770f944a407ab59ae33438fa3ffa => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:42:06.183898 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:42:06.185338 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:42:06.198282 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed9411-ad95-42de-9e0a-7540717ac626 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:42:06.253320 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:42:06.253900 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:42:06.254119 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:42:06.254397 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] PATH_INFO: `/v3/users/f00cb556303d40f1adf2aa482a931db8` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:42:06.255829 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00cb556303d40f1adf2aa482a931db8)` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:42:06.257928 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:42:06.263096 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:06.303335 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00cb556303d40f1adf2aa482a931db8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.310115 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00cb556303d40f1adf2aa482a931db8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.317332 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00cb556303d40f1adf2aa482a931db8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.317954 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00cb556303d40f1adf2aa482a931db8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.318648 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.notifications [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00cb556303d40f1adf2aa482a931db8'} {{(pid=93163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.335930 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1459/2949] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Sep 1 00:42:06 2022] DELETE /identity/v3/users/f00cb556303d40f1adf2aa482a931db8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:42:06.513420 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Authenticating user token {{(pid=93164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:42:06.514867 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.fernet_utils [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:42:06.527893 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d71e-3225-49de-b398-8c7ea3078e51 admin admin] Validating token access rules against request {{(pid=93164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:42:06.585034 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f836d711bd446dd99381e699620c0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e0be78705643f38f372c4bbaf2a54a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:42:06.585665 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:42:06.585947 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:42:06.586220 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] PATH_INFO: `/v3/projects/652d58adb3a84b8ba5c2345123c56209` {{(pid=93164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:42:06.587331 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652d58adb3a84b8ba5c2345123c56209)` {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:42:06.589321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] RBAC: Authorization granted {{(pid=93164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:42:06.610932 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:06.640128 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652d58adb3a84b8ba5c2345123c56209', 'request_id': 'req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.646198 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652d58adb3a84b8ba5c2345123c56209', 'request_id': 'req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.653321 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652d58adb3a84b8ba5c2345123c56209', 'request_id': 'req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07'} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.663577 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] The token cache is being invalidate because project 652d58adb3a84b8ba5c2345123c56209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93164) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 00:42:06.663861 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.664500 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG keystone.notifications [None req-812cba34-06fc-4d9c-b20f-0e2a12ca7f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93164) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 00:42:06.666461 dv-cinder-820027-21-smb devstack@keystone.service[93164]: [pid: 93164|app: 0|req: 1491/2950] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Sep 1 00:42:06 2022] DELETE /identity/v3/projects/652d58adb3a84b8ba5c2345123c56209 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 00:42:16.332192 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:16.660686 dv-cinder-820027-21-smb devstack@keystone.service[93164]: DEBUG dbcounter [-] [93164] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:43:07.304502 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Authenticating user token {{(pid=93163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 00:43:07.305906 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:43:07.374995 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172a45d-dc9f-44d2-8e50-5df87469c723 admin admin] Validating token access rules against request {{(pid=93163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 00:43:07.432968 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170a4ea-f9bb-45e1-8651-7e35e439a67c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db5c6d78083342ab923e2258b763dc36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40cd74f2fffc49a99b6f11230064325a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 00:43:07.433572 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170a4ea-f9bb-45e1-8651-7e35e439a67c service placement] REQUEST_METHOD: `GET` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 00:43:07.433858 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170a4ea-f9bb-45e1-8651-7e35e439a67c service placement] SCRIPT_NAME: `/identity` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 00:43:07.434122 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170a4ea-f9bb-45e1-8651-7e35e439a67c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 00:43:07.436374 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.fernet_utils [None req-e170a4ea-f9bb-45e1-8651-7e35e439a67c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 00:43:07.447380 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170a4ea-f9bb-45e1-8651-7e35e439a67c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 00:43:07.448998 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170a4ea-f9bb-45e1-8651-7e35e439a67c service placement] RBAC: Authorization granted {{(pid=93163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 00:43:07.459439 dv-cinder-820027-21-smb devstack@keystone.service[93163]: [pid: 93163|app: 0|req: 1460/2951] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Sep 1 00:43:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 00:43:17.455139 dv-cinder-820027-21-smb devstack@keystone.service[93163]: DEBUG dbcounter [-] [93163] Writing DB stats keystone:SELECT=58 {{(pid=93163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}